00000001:02000400:0.0F:1788651584.160937:0:3289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1788651603.565580:0:3512:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788651605.648768:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 515 MB/s 00000001:01000000:3.0F:1788651605.903015:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 505 MB/s 00000001:01000000:3.0:1788651606.153022:0:3562:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4411 MB/s 00000020:02000000:1.0F:1788651606.963048:0:3604:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g557ce73 00000400:02000000:1.0:1788651607.914004:0:3619:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.145@tcp [8/256/0/180] 00008000:02000000:3.0:1788651611.300999:0:3768:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788651673.844458:0:5737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788651688.245231:0:6487:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788651688.245237:0:6487:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788651688.245238:0:6487:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788651688.245374:0:6487:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000002e9e2455 00000080:02000400:2.0:1788651688.245384:0:6487:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788651688.253735:0:6487:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788651688.253750:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788651688.253792:0:6487:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006d369883) 00000020:00000080:2.0:1788651688.253811:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788651688.339891:0:6487:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788651688.340222:0:6487:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:1.0:1788651688.367222:0:6487:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788651688.367491:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788651688.367499:0:6487:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788651688.367512:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c3707 00000020:01000004:1.0:1788651688.367682:0:6487:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788651688.367690:0:6487:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788651688.367695:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002e9e2455 from MGS 00000020:01000004:1.0:1788651688.367700:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788651688.367719:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000003a998224) 00000020:00000080:1.0:1788651688.367731:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788651688.367835:0:6487:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002e9e2455 from MGS, refs=2 00080000:01000000:1.0:1788651688.367841:0:6487:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788651688.367846:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c3715 00000100:00100000:1.0:1788651688.368088:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788651688.368248:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788651688.368255:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788651688.368859:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788651688.368866:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788651688.371315:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788651688.371603:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788651688.371609:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788651688.373889:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788651688.373904:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788651688.374878:0:6487:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788651688.374887:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788651688.376788:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651688.376793:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651688.376795:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651688.377318:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651688.377320:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651688.377323:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651688.378078:0:6487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788651688.381237:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788651688.628994:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3099 MB/s 00000001:01000000:2.0:1788651688.879808:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3755 MB/s 00000001:01000000:3.0:1788651689.129775:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 403 MB/s 00000001:01000000:1.0:1788651689.386154:0:6487:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 339 MB/s 00080000:10000000:3.0:1788651689.402320:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000040:01000000:3.0:1788651689.431159:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788651689.432257:0:6501:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788651689.432297:0:6487:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788651689.432329:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788651689.432491:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788651689.432511:0:6487:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788651689.432853:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788651689.433590:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788651689.433599:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788651689.439087:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788651689.439101:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788651689.439623:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788651689.439630:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788651689.440352:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788651689.440374:0:6487:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.145@tcp' 00000020:01000004:0.0:1788651689.440377:0:6487:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788651689.440823:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.145@tcp (typ=mgc) 00000020:00000080:0.0:1788651689.440844:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.145@tcp (0000000016c26e30) 00000020:00000080:0.0:1788651689.440865:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00000100:00080000:1.0:1788651689.441098:0:6506:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00080000:0.0:1788651689.441245:0:6487:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000989af960@MGC192.168.204.145@tcp: add connection 192.168.204.145@tcp at head 00010000:00010000:1.0:1788651689.442111:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651689.443779:0:6487:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.145@tcp-0 is initialized 00000040:01000000:0.0:1788651689.443790:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788651689.451709:0:6507:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788651689.451766:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.145@tcp (uuid 1387a7f4-5194-4c3d-9855-aa6dad12ca23) 00000020:00000080:0.0:1788651689.451788:0:6487:0:(genops.c:1385:class_connect()) connect: client 1387a7f4-5194-4c3d-9855-aa6dad12ca23, cookie 0xcd2f56ea038c3723 00000100:00080000:0.0:1788651689.451801:0:6487:0:(import.c:545:import_select_connection()) MGC192.168.204.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788651689.451807:0:6487:0:(import.c:665:import_select_connection()) MGC192.168.204.145@tcp: import 00000000989af960 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788651689.451856:0:6487:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b924487d x1875537147461760/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788651689.452026:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b924487d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3634:1875537147461760:0@lo:250: 00000100:00100000:0.0:1788651689.452126:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788651689.452181:0:6487:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS 00000020:01000004:0.0:1788651689.452204:0:6487:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788651689.452228:0:6487:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788651689.452240:0:6487:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000039dc19e9) 00000020:00000080:0.0:1788651689.452251:0:6487:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788651689.454104:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147461760 00000100:00100000:2.0:1788651689.454117:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147461760 00000100:00100000:2.0:1788651689.454151:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788651689.454157:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce18c8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1875537147461760:12345-0@lo:250: 00010000:00080000:2.0:1788651689.454180:0:6502:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1387a7f4-5194-4c3d-9855-aa6dad12ca23@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:2.0:1788651689.454207:0:6502:0:(genops.c:1385:class_connect()) connect: client 1387a7f4-5194-4c3d-9855-aa6dad12ca23, cookie 0xcd2f56ea038c3731 00000100:00080000:2.0:1788651689.454333:0:6502:0:(import.c:65:import_set_state_nolock()) 0000000052c05959 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788651689.458656:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce18c8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:3634:x1875537147461760:12345-0@lo:250: Request processed in 4491us (6522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651689.458672:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788651689.458733:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788651689.458743:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.145@tcp: connect to target with instance 0 00000100:00080000:2.0:1788651689.458752:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788651689.458756:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788651689.458760:0:3634:0:(import.c:65:import_set_state_nolock()) 00000000989af960 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788651689.458764:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788651689.458767:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788651689.458782:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b924487d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3634:1875537147461760:0@lo:250: 00000100:00100000:0.0:1788651689.492275:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788651689.492589:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788651689.492595:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788651689.494218:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788651689.494228:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788651689.495591:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788651689.495601:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788651689.497298:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788651689.497512:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788651689.497518:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788651689.498687:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788651689.498696:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788651689.546199:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788651689.546537:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788651689.546545:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788651689.548547:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788651689.548560:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788651689.549579:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788651689.549759:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788651689.549764:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788651689.550725:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788651689.550734:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788651689.551612:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788651689.551772:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788651689.551777:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788651689.552752:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788651689.552762:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788651689.555294:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788651689.555605:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788651689.555611:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788651689.556562:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788651689.556571:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788651689.590903:0:6487:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788651689.591569:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788651689.591575:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788651689.596517:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788651689.596535:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788651689.598294:0:6487:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788651689.598306:0:6487:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788651689.602415:0:6487:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788651689.602454:0:6487:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1788651689.602460:0:6487:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788651689.602562:0:6487:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788651689.602599:0:6487:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.145@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788651689.602604:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788651689.602606:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788651689.602607:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788651689.602609:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788651689.602610:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788651689.602611:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788651689.602612:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788651689.602613:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788651689.602615:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788651689.602616:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788651689.602617:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788651689.602618:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788651689.602620:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788651689.602622:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788651689.602624:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788651689.602625:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788651689.602626:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788651689.602627:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788651689.602628:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788651689.602629:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788651689.602630:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788651689.602630:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788651689.602631:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788651689.602632:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788651689.602633:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788651689.602664:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788651689.602679:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ca40151 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147461888:0@lo:253: 00000100:00100000:3.0:1788651689.602750:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651689.602800:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000008d4f07a4 going to sleep for 11 seconds 00000100:00100000:0.0:1788651689.602938:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147461888 00000100:00100000:0.0:1788651689.602945:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147461888 00000100:00100000:0.0:1788651689.602998:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788651689.603005:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057fc95b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:6487:x1875537147461888:12345-0@lo:253: 20000000:01000000:0.0:1788651689.603046:0:6505:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788651689.603049:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788651689.603599:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788651689.603646:0:6505:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788651689.604095:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651689.606593:0:6526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788651689.606936:0:6505:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788651689.606941:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788651689.606954:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788651689.606957:0:6505:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788651689.606977:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788651689.607215:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788651689.607590:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788651689.607605:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788651689.607630:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788651689.607645:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788651689.607658:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788651689.607726:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788651689.607734:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788651689.607747:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788651689.607752:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788651689.607762:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788651689.607767:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788651689.607777:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788651689.607803:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788651689.607834:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788651689.607839:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788651689.607846:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788651689.608277:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788651689.608288:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788651689.608303:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788651689.608318:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788651689.608334:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788651689.608342:0:6505:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788651689.608367:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788651689.608374:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788651689.608385:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788651689.608635:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788651689.608649:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788651689.608658:0:6505:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788651689.608680:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788651689.608687:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788651689.608699:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788651689.608851:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788651689.609141:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788651689.609167:0:6505:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788651689.609178:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788651689.609596:0:6527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1788651689.610481:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1788651689.610507:0:6505:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.145@tcp for mdt 20000000:01000000:2.0:1788651689.610510:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.145@tcp (null) (null) (null) 00000040:00080000:2.0:1788651689.610527:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1788651689.610535:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788651689.610549:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1788651689.610554:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.145@tcp (null) (null) 00000040:00080000:2.0:1788651689.610565:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1788651689.610571:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1788651689.610582:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1788651689.610597:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1788651689.610627:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788651689.610630:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788651689.610634:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788651689.610698:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788651689.610700:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788651689.613450:0:6528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788651689.613762:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788651689.613792:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788651689.613807:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788651689.613817:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788651689.613819:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788651689.614584:0:6529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1788651689.614750:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1788651689.614771:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1788651689.614795:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1788651689.614806:0:6505:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788651689.614809:0:6505:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1788651689.614815:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788651689.614818:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788651689.614823:0:6505:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788651689.614829:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788651689.615523:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788651689.615630:0:6505:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788651689.628473:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788651689.628510:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788651689.628527:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788651689.628548:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788651689.628569:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3738 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.628585:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3738 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.628595:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3738 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.628601:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3738 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.628607:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3738 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.628613:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3738 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.628619:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000920b3a73 already unused, calling callback (00000000e30859f5) 00010000:00010000:2.0:1788651689.628633:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3738 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.628640:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3738 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.628652:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3738 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.628659:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3738 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.628664:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3738 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788651689.628678:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788651689.644406:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057fc95b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:6487:x1875537147461888:12345-0@lo:253: Request processed in 41393us (41649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651689.644424:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651689.644548:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ca40151 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147461888:0@lo:253: 10000000:01000000:3.0:1788651689.644580:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788651689.644583:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788651689.644585:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788651689.644586:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788651689.644588:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788651689.644589:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788651689.644590:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788651689.644592:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788651689.644593:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788651689.644595:0:6487:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788651689.644596:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788651689.644598:0:6487:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788651689.644620:0:6487:0:(tgt_mount.c:101:server_register_mount()) register mount 000000002e9e2455 from lustre-MDT0000 10000000:01000000:3.0:1788651689.644649:0:6487:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788651689.644652:0:6487:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788651689.644656:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f86da6c3380 10000000:01000000:3.0:1788651689.644660:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788651689.644668:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f86da6c3380 from 1 10000000:01000000:3.0:1788651689.644671:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788651689.644723:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.644734:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.644744:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651689.644762:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ca40151 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462016:0@lo:101: 00000100:00100000:3.0:1788651689.644799:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651689.644850:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000238f2c73 going to sleep for 11 seconds 00000100:00100000:2.0:1788651689.644936:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147462016 00000100:00100000:2.0:1788651689.644953:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147462016 00000100:00100000:2.0:1788651689.645004:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788651689.645012:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a59ca0b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:6487:x1875537147462016:12345-0@lo:101: 00010000:00010000:2.0:1788651689.645025:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651689.645039:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3746 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c373f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.645061:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c373f expref: 6 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.645082:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c373f expref: 6 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.645093:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000920b3a73, rc 0) 00000100:00100000:2.0:1788651689.645140:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a59ca0b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:6487:x1875537147462016:12345-0@lo:101: Request processed in 130us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651689.645147:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788651689.645426:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ca40151 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462016:0@lo:101: 00010000:00010000:3.0:1788651689.645449:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.645456:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651689.645508:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ca40151 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462144:0@lo:501: 00000100:00100000:3.0:1788651689.645549:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651689.645577:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000238f2c73 going to sleep for 11 seconds 00000100:00100000:0.0:1788651689.645633:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147462144 00000100:00100000:0.0:1788651689.645638:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147462144 00000100:00100000:0.0:1788651689.645675:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788651689.645682:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5b59811 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:6487:x1875537147462144:12345-0@lo:501: 00000100:00100000:0.0:1788651689.645778:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5b59811 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:6487:x1875537147462144:12345-0@lo:501: Request processed in 97us (229us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788651689.645784:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651689.645818:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ca40151 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462144:0@lo:501: 10000000:01000000:3.0:1788651689.645847:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788651689.645952:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.645969:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651689.645979:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f86da667000 10000000:01000000:3.0:1788651689.645984:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788651689.645987:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f86da667000 10000000:01000000:3.0:1788651689.645990:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788651689.645993:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f86da667000 from 1 10000000:01000000:3.0:1788651689.645996:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788651689.646013:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 000000006276d9e3/0xcd2f56ea038c374d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.646020:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 000000006276d9e3/0xcd2f56ea038c374d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.646040:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 000000006276d9e3/0xcd2f56ea038c374d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651689.646052:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001ca40151 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462272:0@lo:101: 00000100:00100000:3.0:1788651689.646091:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651689.646119:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000238f2c73 going to sleep for 11 seconds 00000100:00100000:2.0:1788651689.646362:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147462272 00000100:00100000:2.0:1788651689.646368:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147462272 00000100:00100000:2.0:1788651689.646414:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788651689.646421:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8d1a05e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:6487:x1875537147462272:12345-0@lo:101: 00010000:00010000:2.0:1788651689.646429:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651689.646442:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bc19339a/0xcd2f56ea038c3754 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c374d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.646457:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc19339a/0xcd2f56ea038c3754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c374d expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.646465:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bc19339a/0xcd2f56ea038c3754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c374d expref: 7 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.646473:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bc19339a, rc 0) 00000100:00100000:2.0:1788651689.646514:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8d1a05e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+7:6487:x1875537147462272:12345-0@lo:101: Request processed in 94us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651689.646520:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788651689.646648:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001ca40151 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462272:0@lo:101: 00010000:00010000:0.0:1788651689.646660:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 000000006276d9e3/0xcd2f56ea038c374d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.646668:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 000000006276d9e3/0xcd2f56ea038c374d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651689.646679:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788651689.649230:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 000000006276d9e3/0xcd2f56ea038c374d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.649247:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 000000006276d9e3/0xcd2f56ea038c374d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651689.649257:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788651689.649269:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788651689.649278:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f86da667000 10000000:01000000:0.0:1788651689.649296:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788651689.649300:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788651689.649303:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788651689.649344:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.649351:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.649362:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651689.649384:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cde93d73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462400:0@lo:101: 00000100:00100000:0.0:1788651689.649452:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651689.649496:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a145898 going to sleep for 11 seconds 00000100:00100000:2.0:1788651689.649513:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147462400 00000100:00100000:2.0:1788651689.649523:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147462400 00000100:00100000:2.0:1788651689.649582:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788651689.649600:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024982169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+7:6487:x1875537147462400:12345-0@lo:101: 00010000:00010000:2.0:1788651689.649613:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651689.649625:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f617ab95/0xcd2f56ea038c3762 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c375b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.649659:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f617ab95/0xcd2f56ea038c3762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c375b expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.649669:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f617ab95/0xcd2f56ea038c3762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c375b expref: 8 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.649677:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f617ab95, rc 0) 00000100:00100000:2.0:1788651689.649801:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024982169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+8:6487:x1875537147462400:12345-0@lo:101: Request processed in 201us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651689.649813:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788651689.650672:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cde93d73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462400:0@lo:101: 00010000:00010000:0.0:1788651689.650689:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.650698:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651689.650766:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cde93d73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462528:0@lo:501: 00000100:00100000:0.0:1788651689.650803:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651689.650861:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147462528 00000100:00100000:3.0:1788651689.650867:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147462528 00000100:00100000:3.0:1788651689.650959:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788651689.650988:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a145898 going to sleep for 11 seconds 00000100:00100000:3.0:1788651689.651471:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eae53a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+8:6487:x1875537147462528:12345-0@lo:501: 00000100:00100000:3.0:1788651689.651620:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eae53a95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+9:6487:x1875537147462528:12345-0@lo:501: Request processed in 154us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651689.651653:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cde93d73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462528:0@lo:501: 00000100:00100000:0.0:1788651689.651687:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cde93d73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462656:0@lo:503: 00000100:00100000:0.0:1788651689.651729:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651689.651761:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a145898 going to sleep for 11 seconds 00000100:00100000:1.0:1788651689.651832:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147462656 00000100:00100000:1.0:1788651689.651839:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147462656 00000100:00100000:3.0:1788651689.654651:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788651689.654724:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788651689.654745:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bf4e2467 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:6487:x1875537147462656:12345-0@lo:503: 00000100:00100000:1.0:1788651689.654939:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bf4e2467 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:6487:x1875537147462656:12345-0@lo:503: Request processed in 206us (3210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651689.654957:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788651689.657213:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cde93d73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147462656:0@lo:503: 00000100:00100000:0.0:1788651689.658664:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cde93d73 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6531:1875537147462784:0@lo:502: 00000100:00100000:0.0:1788651689.658760:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651689.658814:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000364e5b2c going to sleep for 11 seconds 00000100:00100000:1.0:1788651689.658928:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147462784 00000100:00100000:1.0:1788651689.658936:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147462784 00000100:00100000:1.0:1788651689.658995:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788651689.659003:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4f110b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:6531:x1875537147462784:12345-0@lo:502: 00000100:00100000:1.0:1788651689.659136:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4f110b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:6531:x1875537147462784:12345-0@lo:502: Request processed in 133us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651689.659145:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788651689.659290:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cde93d73 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6531:1875537147462784:0@lo:502: 00000020:01000000:0.0:1788651689.659317:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651689.659328:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651689.659331:0:6531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788651689.659336:0:6531:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788651689.659338:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788651689.659351:0:6531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000c1098c55) 00000020:00000080:0.0:1788651689.659368:0:6531:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788651689.659374:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788651689.659468:0:6531:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788651689.659474:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c3770 00000020:00000080:0.0:1788651689.659702:0:6531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788651689.659707:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651689.659711:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651689.659712:0:6531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788651689.659715:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651689.659718:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651689.659720:0:6531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788651689.659723:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788651689.659730:0:6531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000005daa44b9) 00000020:00000080:0.0:1788651689.659740:0:6531:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788651689.659745:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788651689.659747:0:6531:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788651689.659750:0:6531:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788651689.659756:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788651689.659798:0:6531:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002e9e2455 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788651689.659823:0:6531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008ed7ac2f) 00000020:00000080:0.0:1788651689.659832:0:6531:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788651689.659894:0:6531:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788651689.659900:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c3785 00000020:00000080:0.0:1788651689.660336:0:6531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788651689.660343:0:6531:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788651689.660347:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd2f56ea038c378c 00080000:01000000:0.0:1788651689.660353:0:6531:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788651689.660356:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c3793 00080000:10000000:0.0:1788651689.660900:0:6531:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788651689.662699:0:6531:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788651689.673304:0:6531:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788651689.798641:0:6531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788651689.799249:0:6531:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788651689.804743:0:6531:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788651689.806651:0:6531:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788651689.811893:0:6531:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000003aedbcbb) 00000020:00000080:2.0:1788651689.812052:0:6531:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788651689.812135:0:6531:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788651689.812142:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c37a1 00000020:00000080:3.0:1788651689.812791:0:6531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788651689.814626:0:6531:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:2.0:1788651689.824540:0:6531:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1788651689.831332:0:6531:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1788651689.835662:0:6531:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:3.0:1788651689.848694:0:6531:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:3.0:1788651689.862864:0:6531:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:3.0:1788651689.866377:0:6531:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd2f56ea038c37a8 00000020:00000080:3.0:1788651689.867420:0:6531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788651689.867432:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651689.867438:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651689.867441:0:6531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788651689.867444:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651689.867447:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651689.867448:0:6531:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788651689.867451:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788651689.867460:0:6531:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788651689.867463:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651689.867465:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651689.867467:0:6531:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788651689.867469:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651689.867473:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651689.867474:0:6531:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788651689.867478:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788651689.867522:0:6531:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788651689.867582:0:6531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007803770b pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6531:1875537147462912:0@lo:502: 00000100:00100000:3.0:1788651689.867667:0:6531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651689.867740:0:6531:0:(client.c:2716:ptlrpc_set_wait()) set 00000000095be0a0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651689.867989:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147462912 00000100:00100000:1.0:1788651689.867996:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147462912 00000100:00100000:1.0:1788651689.868040:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788651689.868049:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000cb32109 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+9:6531:x1875537147462912:12345-0@lo:502: 00000100:00100000:1.0:1788651689.868207:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000cb32109 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+9:6531:x1875537147462912:12345-0@lo:502: Request processed in 159us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651689.868214:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788651689.869231:0:6531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007803770b pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6531:1875537147462912:0@lo:502: 00000020:01000000:3.0:1788651689.869270:0:6531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651689.869279:0:6531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651689.869281:0:6531:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788651689.869285:0:6531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788651689.869616:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788651689.869634:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788651689.869657:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.869667:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651689.869674:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86da667000 from 1 10000000:01000000:2.0:1788651689.869688:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788651689.869732:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.869740:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.869749:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651689.869779:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5173943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463040:0@lo:101: 00000100:00100000:2.0:1788651689.869829:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651689.869858:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000083805ad5 going to sleep for 11 seconds 00000100:00100000:3.0:1788651689.870359:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147463040 00000100:00100000:3.0:1788651689.870366:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147463040 00000100:00100000:3.0:1788651689.870566:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788651689.870575:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f73800a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+9:6487:x1875537147463040:12345-0@lo:101: 00010000:00010000:3.0:1788651689.870587:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651689.870602:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000610d8455/0xcd2f56ea038c37b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c37af expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.870625:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000610d8455/0xcd2f56ea038c37b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c37af expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.870636:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000610d8455/0xcd2f56ea038c37b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c37af expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.870660:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000610d8455, rc 0) 00000100:00100000:3.0:1788651689.870704:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f73800a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:6487:x1875537147463040:12345-0@lo:101: Request processed in 130us (875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651689.870710:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788651689.870800:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5173943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463040:0@lo:101: 00010000:00010000:2.0:1788651689.870814:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.870823:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651689.872339:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5173943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463168:0@lo:256: 00000100:00100000:2.0:1788651689.872527:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651689.872607:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 0000000083805ad5 going to sleep for 11 seconds 00000100:00100000:3.0:1788651689.872726:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147463168 00000100:00100000:3.0:1788651689.872734:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147463168 00000100:00100000:3.0:1788651689.872884:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788651689.872893:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cf842e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:6487:x1875537147463168:12345-0@lo:256: 20000000:01000000:2.0:1788651689.873551:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788651689.873558:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788651689.874104:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cf842e31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:6487:x1875537147463168:12345-0@lo:256: Request processed in 1211us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651689.874114:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788651689.874563:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5173943 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463168:0@lo:256: 10000000:01000000:0.0:1788651689.875878:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788651689.876357:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.876370:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651689.876378:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86da667000 from 1 10000000:01000000:0.0:1788651689.876392:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788651689.876583:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.876592:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.876603:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651689.876641:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cde93d73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463296:0@lo:101: 00000100:00100000:0.0:1788651689.876711:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651689.876804:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 000000001a145898 going to sleep for 11 seconds 00000100:00100000:2.0:1788651689.878586:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147463296 00000100:00100000:2.0:1788651689.878608:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147463296 00000100:00100000:2.0:1788651689.878703:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788651689.878711:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046d5da61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:6487:x1875537147463296:12345-0@lo:101: 00010000:00010000:2.0:1788651689.878726:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651689.878742:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f09f8b0d/0xcd2f56ea038c37c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c37bd expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.878778:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f09f8b0d/0xcd2f56ea038c37c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c37bd expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.878789:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f09f8b0d/0xcd2f56ea038c37c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c37bd expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.878798:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f09f8b0d, rc 0) 00000100:00100000:2.0:1788651689.879530:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046d5da61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:6487:x1875537147463296:12345-0@lo:101: Request processed in 816us (2816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651689.879538:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651689.882949:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cde93d73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463296:0@lo:101: 00010000:00010000:1.0:1788651689.882987:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651689.883001:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651689.883150:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463424:0@lo:501: 00000100:00100000:1.0:1788651689.883369:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651689.883639:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000677e6526 going to sleep for 11 seconds 00000100:00100000:2.0:1788651689.884587:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147463424 00000100:00100000:2.0:1788651689.884598:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147463424 00000100:00100000:2.0:1788651689.884658:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788651689.884667:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084d68eb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:6487:x1875537147463424:12345-0@lo:501: 00000100:00100000:2.0:1788651689.884874:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084d68eb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:6487:x1875537147463424:12345-0@lo:501: Request processed in 207us (1505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651689.884882:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788651689.885193:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463424:0@lo:501: 00000100:00100000:1.0:1788651689.885242:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463552:0@lo:503: 00000100:00100000:1.0:1788651689.885292:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651689.885324:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000677e6526 going to sleep for 11 seconds 00000100:00100000:2.0:1788651689.885540:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147463552 00000100:00100000:2.0:1788651689.885546:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147463552 00000100:00100000:2.0:1788651689.885567:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788651689.885573:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003fb8b186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:6487:x1875537147463552:12345-0@lo:503: 00000040:00080000:2.0:1788651689.885607:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788651689.885659:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003fb8b186 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:6487:x1875537147463552:12345-0@lo:503: Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651689.885666:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788651689.885849:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463552:0@lo:503: 00000040:00080000:2.0:1788651689.887340:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788651689.887835:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788651689.887857:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788651689.887950:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651689.887963:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651689.888017:0:6487:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788651689.888020:0:6487:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f86da667000 10000000:01000000:1.0:1788651689.888023:0:6487:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f86da667000 10000000:01000000:1.0:1788651689.888027:0:6487:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788651689.888033:0:6487:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86da667000 from 1 10000000:01000000:1.0:1788651689.888035:0:6487:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788651689.888078:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651689.888087:0:6487:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651689.888109:0:6487:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651689.888129:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463680:0@lo:101: 00000100:00100000:1.0:1788651689.888197:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651689.888233:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cdf7894f going to sleep for 11 seconds 00000100:00100000:2.0:1788651689.888597:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147463680 00000100:00100000:2.0:1788651689.888605:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147463680 00000100:00100000:2.0:1788651689.888659:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788651689.888668:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b90bbad2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:6487:x1875537147463680:12345-0@lo:101: 00010000:00010000:2.0:1788651689.888680:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651689.888692:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003cbd7a90/0xcd2f56ea038c37d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c37cb expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.888717:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003cbd7a90/0xcd2f56ea038c37d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c37cb expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.888728:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003cbd7a90/0xcd2f56ea038c37d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c37cb expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.888736:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003cbd7a90, rc 0) 00000100:00100000:2.0:1788651689.888795:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b90bbad2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6487:x1875537147463680:12345-0@lo:101: Request processed in 129us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651689.888802:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788651689.889064:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463680:0@lo:101: 00010000:00010000:1.0:1788651689.889088:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651689.889097:0:6487:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651689.889171:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463808:0@lo:501: 00000100:00100000:1.0:1788651689.889214:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651689.889243:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cdf7894f going to sleep for 11 seconds 00000100:00100000:0.0:1788651689.889356:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147463808 00000100:00100000:0.0:1788651689.889362:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147463808 00000100:00100000:0.0:1788651689.889398:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788651689.889404:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d5a6205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6487:x1875537147463808:12345-0@lo:501: 00000100:00100000:0.0:1788651689.889527:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d5a6205 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6487:x1875537147463808:12345-0@lo:501: Request processed in 123us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651689.889534:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788651689.889720:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463808:0@lo:501: 00000100:00100000:1.0:1788651689.889749:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463936:0@lo:503: 00000100:00100000:1.0:1788651689.889800:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651689.889821:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cdf7894f going to sleep for 11 seconds 00000100:00100000:2.0:1788651689.889965:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147463936 00000100:00100000:2.0:1788651689.889970:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147463936 00000100:00100000:2.0:1788651689.890000:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788651689.890006:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000278cff28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6487:x1875537147463936:12345-0@lo:503: 00000100:00100000:2.0:1788651689.890100:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000278cff28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6487:x1875537147463936:12345-0@lo:503: Request processed in 94us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651689.890108:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788651689.890365:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147463936:0@lo:503: 00000100:00100000:1.0:1788651689.891247:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6536:1875537147464064:0@lo:502: 00000100:00100000:1.0:1788651689.891296:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651689.891333:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fcb64488 going to sleep for 11 seconds 00000100:00100000:3.0:1788651689.891545:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147464064 00000100:00100000:3.0:1788651689.891551:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147464064 00000100:00100000:3.0:1788651689.891595:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788651689.891603:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f39f2ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6536:x1875537147464064:12345-0@lo:502: 00000100:00100000:3.0:1788651689.891712:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f39f2ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6536:x1875537147464064:12345-0@lo:502: Request processed in 109us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651689.891720:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788651689.892042:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6536:1875537147464064:0@lo:502: 00000020:01000004:1.0:1788651689.892121:0:6536:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788651689.892135:0:6536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000013d89000) 00000020:00000080:1.0:1788651689.892152:0:6536:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788651689.892266:0:6536:0:(tgt_mount.c:153:server_get_mount()) get mount 000000002e9e2455 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788651689.892270:0:6536:0:(tgt_mount.c:187:server_put_mount()) put mount 000000002e9e2455 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788651689.892273:0:6536:0:(obd_mount.c:710:lustre_put_lsi()) put 000000002e9e2455 4 00010000:00080000:1.0:1788651689.892301:0:6536:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001ac49fe7@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:1.0:1788651689.897347:0:6536:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788651689.897587:0:6536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788651689.897632:0:6536:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788651689.897646:0:6536:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd2f56ea038c37e0 00000100:00080000:1.0:1788651689.897659:0:6536:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788651689.897664:0:6536:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001ac49fe7 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788651689.897705:0:6536:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009d722932 x1875537147464192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788651689.897738:0:6536:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788651689.897955:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147464192:0@lo:38: 00000100:00100000:0.0:1788651689.898037:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651689.902256:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147464192 00000100:00100000:1.0:1788651689.902271:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147464192 00000100:00100000:1.0:1788651689.902322:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651689.902328:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000648a39e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147464192:12345-0@lo:38: 00000100:00100000:1.0:1788651689.902440:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000648a39e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147464192:12345-0@lo:38: Request processed in 110us (4402us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788651689.902447:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651689.902495:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788651689.902503:0:3634:0:(import.c:65:import_set_state_nolock()) 000000001ac49fe7 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788651689.902508:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788651689.902511:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147464192:0@lo:38: 00000100:00100000:1.0:1788651689.907287:0:6536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6536:1875537147464320:0@lo:502: 00000100:00100000:1.0:1788651689.907376:0:6536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651689.907564:0:6536:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ae02c31e going to sleep for 11 seconds 00000100:00100000:0.0:1788651689.907701:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147464320 00000100:00100000:0.0:1788651689.907710:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147464320 00000100:00100000:0.0:1788651689.907772:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788651689.907780:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b14444d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6536:x1875537147464320:12345-0@lo:502: 00000100:00100000:0.0:1788651689.908091:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b14444d8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6536:x1875537147464320:12345-0@lo:502: Request processed in 311us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651689.908099:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788651689.908332:0:6536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6536:1875537147464320:0@lo:502: 00000040:00080000:1.0:1788651689.908364:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1788651689.908625:0:6487:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788651689.908647:0:6487:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788651689.908667:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651689.908677:0:6487:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788651689.908722:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788651689.908724:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788651689.908726:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788651689.908727:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788651689.908728:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788651689.908729:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788651689.908730:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788651689.908732:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788651689.908733:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788651689.908734:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788651689.908735:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788651689.908737:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788651689.908740:0:6487:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788651689.908743:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788651689.908744:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788651689.908745:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788651689.908746:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788651689.908747:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788651689.908748:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788651689.908749:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788651689.908750:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788651689.908761:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788651689.908762:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788651689.908762:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788651689.908763:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788651689.908782:0:6487:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788651689.908793:0:6487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fd1cd832 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147464448:0@lo:253: 00000100:00100000:2.0:1788651689.908831:0:6487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651689.908868:0:6487:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c4b8f9a0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651689.909133:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147464448 00000100:00100000:0.0:1788651689.909140:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147464448 00000100:00100000:0.0:1788651689.909194:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788651689.909203:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c507e723 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6487:x1875537147464448:12345-0@lo:253: 20000000:01000000:0.0:1788651689.909226:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788651689.909240:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788651689.917662:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788651689.917698:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788651689.918193:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c507e723 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6487:x1875537147464448:12345-0@lo:253: Request processed in 8988us (9357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651689.918206:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788651689.918272:0:6487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fd1cd832 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6487:1875537147464448:0@lo:253: 10000000:01000000:2.0:1788651689.918285:0:6487:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788651689.918288:0:6487:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788651689.918290:0:6487:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788651689.918291:0:6487:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788651689.918292:0:6487:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788651689.918293:0:6487:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788651689.918295:0:6487:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788651689.918296:0:6487:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788651689.918297:0:6487:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788651689.918298:0:6487:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788651689.918299:0:6487:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788651689.918300:0:6487:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788651689.918302:0:6487:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788651689.918316:0:6487:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788651689.925301:0:6525:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788651689.925330:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788651689.925360:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.926109:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000610d8455/0xcd2f56ea038c37b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c37af expref: 11 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.926121:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.926494:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000610d8455/0xcd2f56ea038c37b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c37af expref: 11 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.926512:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000610d8455/0xcd2f56ea038c37b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c37af expref: 11 pid: 6502 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651689.926528:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033b0fcc6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147464576:0@lo:104: 00000100:00100000:0.0:1788651689.926599:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651689.926662:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set 00000000994a8a53 going to sleep for 11 seconds 00000100:00100000:3.0:1788651689.927323:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147464576 00000100:00100000:3.0:1788651689.927333:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147464576 00000100:00100000:3.0:1788651689.927458:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788651689.927467:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b73c727 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6525:x1875537147464576:12345-0@lo:104: 00010000:00010000:3.0:1788651689.927483:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.927560:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788651689.927567:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b73c727 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6525:x1875537147464576:12345-0@lo:104: Request processed in 101us (968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651689.927574:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788651689.927701:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033b0fcc6 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147464576:0@lo:104: 00010000:00010000:0.0:1788651689.927736:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.936337:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651689.936349:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.936362:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000072b980c3 already unused, calling callback (00000000db8c17d1) 10000000:00010000:0.0:1788651689.936366:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.936420:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651689.936427:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651689.936432:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788651689.936490:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.936497:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651689.936515:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.936522:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: 0000000072b980c3/0xcd2f56ea038c37af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37b6 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651689.936540:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651689.936542:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651689.936544:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651689.936618:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000033b0fcc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147464704:0@lo:103: 00000100:00100000:0.0:1788651689.936684:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651689.939131:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147464704 00000100:00100000:3.0:1788651689.939150:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147464704 00010000:00010000:3.0:1788651689.939581:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000610d8455/0xcd2f56ea038c37b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c37af expref: 12 pid: 6502 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651689.939723:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788651689.939734:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d73fbda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:3636:x1875537147464704:12345-0@lo:103: 00010000:00010000:3.0:1788651689.939750:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651689.939766:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000610d8455/0xcd2f56ea038c37b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c37af expref: 12 pid: 6502 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.939778:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000610d8455/0xcd2f56ea038c37b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c37af expref: 12 pid: 6502 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.939794:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000610d8455/0xcd2f56ea038c37b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c37af expref: 12 pid: 6502 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.939809:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.939816:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788651689.939833:0:6495:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014503933s 00010000:00010000:3.0:1788651689.939837:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.939844:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.939850:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.939877:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.939883:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000702c4760 already unused, calling callback (00000000e30859f5) 00010000:00010000:3.0:1788651689.939886:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.939893:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.939949:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651689.939962:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651689.940036:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d73fbda pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:3636:x1875537147464704:12345-0@lo:103: Request processed in 306us (3352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651689.940044:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788651689.940106:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000033b0fcc6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147464704:0@lo:103: 00080000:10000000:3.0:1788651689.940861:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1788651689.941060:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788651689.941295:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1788651689.941445:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788651689.941626:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1788651689.941781:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00010000:00010000:1.0:1788651689.942632:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651689.942646:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651689.942652:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000702c4760/0xcd2f56ea038c37e7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788651689.944111:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1788651689.944398:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788651689.944630:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1788651689.945287:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788651689.945653:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1788651689.946420:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:0.0:1788651689.957589:0:6487:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788651689.975157:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788651689.975365:0:6541:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788651689.975369:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788651689.975629:0:6542:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788651689.979171:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788651689.979545:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788651689.983578:0:6487:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788651689.983598:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788651689.985310:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651689.987618:0:6487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788651689.988269:0:6487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788651689.988311:0:6487:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788651689.989363:0:6487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788651689.989514:0:6542:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788651689.990101:0:6487:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788651690.002317:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788651690.003800:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00000040:00080000:0.0:1788651690.005701:0:6542:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788651690.005808:0:6542:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:0.0:1788651690.005812:0:6542:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1788651690.007800:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788651690.008165:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788651690.008629:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788651690.010660:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788651690.011884:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788651690.013556:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788651690.015030:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788651690.015700:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788651690.018856:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788651690.019676:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788651690.020251:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788651690.021637:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788651690.021862:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788651690.022056:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788651690.024863:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788651690.025099:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788651690.027897:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788651690.029350:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788651690.031646:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788651690.031808:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788651690.031973:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788651690.032199:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788651690.032351:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788651690.036282:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788651690.036522:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788651690.036666:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788651690.036838:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788651690.037051:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788651690.037230:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788651690.037375:0:6487:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788651690.038750:0:6487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788651690.050563:0:6487:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788651690.050609:0:6487:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa71c01a73988 00100000:10000000:2.0:1788651690.050617:0:6487:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788651690.053682:0:6487:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788651690.053704:0:6487:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788651690.054556:0:6487:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788651690.054575:0:6487:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788651690.061301:0:6487:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788651690.061614:0:6487:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788651690.473523:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651691.487999:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651692.514630:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651693.536117:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651694.562778:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788651695.074087:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788651695.074097:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788651695.074100:0:8:0:(import.c:65:import_set_state_nolock()) 000000001ac49fe7 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788651695.074114:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001ac49fe7 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788651695.074135:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ecb53f27 x1875537147464960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788651695.074171:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ecb53f27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147464960:0@lo:38: 00000100:00100000:3.0:1788651695.074239:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651695.074255:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651695.074271:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007803770b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147464832:0@lo:400: 00000100:00100000:3.0:1788651695.074304:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147464960 00000100:00100000:1.0:1788651695.074305:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651695.074311:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147464960 00000100:00100000:3.0:1788651695.074341:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 10000000:01000000:1.0:1788651695.074343:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 00000100:00100000:3.0:1788651695.074347:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023d25f86 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875537147464960:12345-0@lo:38: 10000000:01000000:1.0:1788651695.074347:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86da667000 from 3 10000000:01000000:1.0:1788651695.074350:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00080000:3.0:1788651695.074368:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00010000:00010000:1.0:1788651695.074376:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651695.074385:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651695.074393:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788651695.074397:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd2f56ea038c37f5 00000100:00100000:1.0:1788651695.074405:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147465088:0@lo:101: 00000100:00100000:1.0:1788651695.074428:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00100000:3.0:1788651695.074437:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1788651695.074440:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000213cf9b9 going to sleep for 11 seconds 00000100:00100000:1.0:1788651695.074455:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147464832 00000100:00100000:1.0:1788651695.074458:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147464832 00000100:00100000:1.0:1788651695.074485:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147465088 00000100:00100000:1.0:1788651695.074487:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147465088 00000100:00100000:1.0:1788651695.074499:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788651695.074504:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bef60c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:3638:x1875537147464832:12345-0@lo:400: 00000100:00100000:1.0:1788651695.074541:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bef60c12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:3638:x1875537147464832:12345-0@lo:400: Request processed in 37us (236us total) trans 0 rc 0/0 00000100:00080000:3.0:1788651695.074543:0:6511:0:(import.c:65:import_set_state_nolock()) 00000000deebf8e1 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788651695.074547:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788651695.074572:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788651695.074574:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023d25f86 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875537147464960:12345-0@lo:38: Request processed in 227us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651695.074577:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec939e5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:6507:x1875537147465088:12345-0@lo:101: 00000100:00100000:3.0:1788651695.074581:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788651695.074583:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651695.074600:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002661fa2d/0xcd2f56ea038c37fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c37ee expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788651695.074611:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ecb53f27 x1875537147464960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788651705 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1788651695.074618:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002661fa2d/0xcd2f56ea038c37fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c37ee expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788651695.074623:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00010000:00010000:1.0:1788651695.074626:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002661fa2d/0xcd2f56ea038c37fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c37ee expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788651695.074629:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00010000:00010000:1.0:1788651695.074634:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002661fa2d, rc 0) 00000100:00080000:3.0:1788651695.074638:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788651695.074640:0:3634:0:(import.c:65:import_set_state_nolock()) 000000001ac49fe7 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788651695.074645:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ecb53f27 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147464960:0@lo:38: 00000100:00100000:1.0:1788651695.074659:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec939e5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6507:x1875537147465088:12345-0@lo:101: Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651695.074664:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788651695.074708:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147465088:0@lo:101: 00010000:00010000:1.0:1788651695.074720:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651695.074728:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651695.074765:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147465216:0@lo:256: 00000100:00100000:1.0:1788651695.074794:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651695.074816:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000213cf9b9 going to sleep for 11 seconds 00000100:00100000:1.0:1788651695.074832:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007803770b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147464832:0@lo:400: 00000100:00100000:3.0:1788651695.075071:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147465216 00000100:00100000:3.0:1788651695.075076:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147465216 00000100:00100000:3.0:1788651695.075100:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788651695.075105:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b2130b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6507:x1875537147465216:12345-0@lo:256: 20000000:01000000:3.0:1788651695.075119:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788651695.075134:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788651695.075138:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788651695.075214:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b2130b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:6507:x1875537147465216:12345-0@lo:256: Request processed in 108us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651695.075221:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788651695.075250:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009d722932 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147465216:0@lo:256: 10000000:01000000:3.0:1788651695.075286:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788651695.075292:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651695.075300:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1788651695.306827:0:6787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788651695.584527:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788651696.566523:0:6839:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788651696.566737:0:6839:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788651696.608863:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651697.633008:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651698.656983:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651699.680134:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788651699.802467:0:6941:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788651699.802770:0:6941:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788651700.192583:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002d309036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147465472:0@lo:400: 00000100:00100000:3.0:1788651700.192664:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651700.192736:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651700.192745:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000114013b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147465344:0@lo:400: 00000100:00100000:0.0:1788651700.192790:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651700.192858:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147465344 00000100:00100000:3.0:1788651700.192866:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147465344 00000100:00100000:3.0:1788651700.192949:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788651700.192972:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e5fa5de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:3637:x1875537147465344:12345-0@lo:400: 00000100:00100000:3.0:1788651700.193030:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e5fa5de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:3637:x1875537147465344:12345-0@lo:400: Request processed in 60us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651700.193038:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788651700.193152:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147465472 00000100:00100000:1.0:1788651700.193166:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147465472 00000100:00100000:1.0:1788651700.193321:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651700.193329:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecb53f27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147465472:12345-0@lo:400: 00000100:00100000:1.0:1788651700.193574:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecb53f27 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147465472:12345-0@lo:400: Request processed in 246us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651700.193582:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788651700.196631:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002d309036 x1875537147465472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651716 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651700.196654:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002d309036 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147465472:0@lo:400: 00000100:00100000:2.0:1788651700.198747:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000114013b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147465344:0@lo:400: 00010000:00010000:0.0:1788651700.705601:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651701.728239:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651702.752716:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651703.783602:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651704.803895:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651705.320819:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651705.320846:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024e9f6ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147465600:0@lo:400: 00000100:00100000:1.0:1788651705.320982:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651705.321126:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c8d26efd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147465728:0@lo:400: 00000100:00100000:2.0:1788651705.321167:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651705.321306:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147465728 00000100:00100000:1.0:1788651705.321317:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147465728 00000100:00100000:1.0:1788651705.321388:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788651705.321397:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd1cd832 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147465728:12345-0@lo:400: 00000100:00100000:1.0:1788651705.321455:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd1cd832 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147465728:12345-0@lo:400: Request processed in 59us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651705.321461:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788651705.321618:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c8d26efd x1875537147465728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651705.321632:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c8d26efd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147465728:0@lo:400: 00000100:00100000:0.0:1788651705.322461:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147465600 00000100:00100000:0.0:1788651705.322472:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147465600 00000100:00100000:0.0:1788651705.330262:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788651705.330275:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b68804f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:3635:x1875537147465600:12345-0@lo:400: 00000100:00100000:0.0:1788651705.330373:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b68804f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:3635:x1875537147465600:12345-0@lo:400: Request processed in 100us (9391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651705.330381:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788651705.336238:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024e9f6ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147465600:0@lo:400: 00010000:00010000:3.0:1788651705.824283:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651706.863084:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651707.879205:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651708.897257:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651709.927351:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651710.436701:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651710.436734:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f2edfae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147465984:0@lo:400: 00000100:00100000:3.0:1788651710.436817:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651710.440241:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651710.440274:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052c3961a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147465856:0@lo:400: 00000100:00100000:0.0:1788651710.440369:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651710.441949:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147465984 00000100:00100000:1.0:1788651710.441985:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147465984 00000100:00100000:1.0:1788651710.442053:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788651710.442074:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057adc9a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147465984:12345-0@lo:400: 00000100:00100000:1.0:1788651710.442171:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057adc9a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147465984:12345-0@lo:400: Request processed in 98us (5355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651710.442179:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788651710.442280:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002f2edfae x1875537147465984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651710.442294:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f2edfae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147465984:0@lo:400: 00000100:00100000:3.0:1788651710.442553:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147465856 00000100:00100000:3.0:1788651710.442559:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147465856 00000100:00100000:3.0:1788651710.442716:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651710.442724:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8553e01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:3637:x1875537147465856:12345-0@lo:400: 00000100:00100000:3.0:1788651710.442763:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8553e01 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:3637:x1875537147465856:12345-0@lo:400: Request processed in 42us (2396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651710.442770:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788651710.442858:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052c3961a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147465856:0@lo:400: 00010000:00010000:0.0:1788651710.944231:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788651711.907100:0:7439:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788651711.907105:0:7439:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788651711.907106:0:7439:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788651711.907255:0:7439:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000011df1cb7 00000020:01000004:1.0:1788651711.907273:0:7439:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:1.0:1788651711.907284:0:7439:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788651711.907297:0:7439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000086ab8e9b) 00000020:00000080:1.0:1788651711.907311:0:7439:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00010000:00010000:1.0:1788651711.968312:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788651712.025185:0:7439:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1788651712.025263:0:7439:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:1.0:1788651712.074672:0:7439:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788651712.080068:0:7439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788651712.080081:0:7439:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788651712.080092:0:7439:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c380a 00000020:01000004:2.0:1788651712.080098:0:7439:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788651712.080119:0:7439:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788651712.080121:0:7439:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788651712.080127:0:7439:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788651712.080152:0:7439:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788651712.080156:0:7439:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788651712.123677:0:7439:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788651712.123718:0:7439:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.145@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788651712.123723:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788651712.123725:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788651712.123726:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788651712.123727:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788651712.123733:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788651712.123734:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788651712.123736:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788651712.123737:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788651712.123738:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788651712.123739:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788651712.123740:0:7439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788651712.123744:0:7439:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788651712.123746:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788651712.123747:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788651712.123748:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788651712.123749:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788651712.123750:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788651712.123751:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788651712.123752:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788651712.123752:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788651712.123753:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788651712.123754:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788651712.123755:0:7439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788651712.123783:0:7439:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788651712.123801:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053848ac0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147466112:0@lo:253: 00000100:00100000:2.0:1788651712.124727:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.124785:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 0000000040ebfb3a going to sleep for 11 seconds 00000100:00100000:3.0:1788651712.125201:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147466112 00000100:00100000:3.0:1788651712.125223:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147466112 00000100:00100000:3.0:1788651712.125403:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788651712.125412:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2a88e77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:7439:x1875537147466112:12345-0@lo:253: 20000000:01000000:3.0:1788651712.125461:0:6505:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788651712.125466:0:6505:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:3.0:1788651712.125471:0:6505:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:3.0:1788651712.125474:0:6505:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:3.0:1788651712.125513:0:6505:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:3.0:1788651712.125756:0:6505:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788651712.127284:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788651712.127313:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788651712.128622:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788651712.128680:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788651712.128699:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788651712.128794:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:3.0:1788651712.128804:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:3.0:1788651712.128819:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:3.0:1788651712.128825:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:3.0:1788651712.128846:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:3.0:1788651712.128852:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:3.0:1788651712.128866:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788651712.128880:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788651712.129328:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:3.0:1788651712.129340:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.145@tcp (null) (null) (null) 00000040:00080000:3.0:1788651712.129374:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:3.0:1788651712.129382:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788651712.129426:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:3.0:1788651712.129434:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.204.145@tcp (null) (null) 00000040:00080000:3.0:1788651712.129449:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:3.0:1788651712.129455:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788651712.129469:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788651712.129486:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788651712.129498:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:3.0:1788651712.129583:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:3.0:1788651712.129595:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:3.0:1788651712.129611:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1788651712.129691:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1788651712.129722:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1788651712.129730:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1788651712.129744:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1788651712.129769:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1788651712.129775:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1788651712.129807:0:6505:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1788651712.129814:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:1.0:1788651712.131102:0:7446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1788651712.131528:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788651712.131563:0:6505:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.145@tcp for mdt 20000000:01000000:2.0:1788651712.131565:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.145@tcp (null) (null) (null) 00000040:00080000:2.0:1788651712.131592:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788651712.131616:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1788651712.131650:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788651712.131659:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.204.145@tcp (null) (null) 00000040:00080000:2.0:1788651712.131686:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788651712.131695:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:2.0:1788651712.131721:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:2.0:1788651712.131749:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:2.0:1788651712.131857:0:6505:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:2.0:1788651712.131872:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1788651712.135293:0:7447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:3.0:1788651712.135652:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788651712.135683:0:6505:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.204.145@tcp for mdt 20000000:01000000:3.0:1788651712.135686:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.145@tcp (null) (null) (null) 00000040:00080000:3.0:1788651712.135703:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788651712.135722:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788651712.135737:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788651712.135742:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.204.145@tcp (null) (null) 00000040:00080000:3.0:1788651712.135755:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788651712.135762:0:6505:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:3.0:1788651712.135774:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788651712.135788:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:3.0:1788651712.135816:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788651712.135819:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788651712.135823:0:6505:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788651712.136119:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788651712.136123:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788651712.137230:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788651712.137272:0:7448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788651712.137288:0:7448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788651712.137590:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788651712.137613:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788651712.137635:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788651712.137659:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788651712.137661:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788651712.138147:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788651712.138167:0:7449:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788651712.138178:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788651712.138799:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:0.0:1788651712.138826:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:0.0:1788651712.138949:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:0.0:1788651712.139137:0:6505:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788651712.139140:0:6505:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788651712.139764:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788651712.139789:0:7450:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788651712.139803:0:7450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:2.0:1788651712.142088:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:2.0:1788651712.142124:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:2.0:1788651712.142145:0:6505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:2.0:1788651712.142162:0:6505:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788651712.142165:0:6505:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788651712.142169:0:6505:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788651712.142177:0:6505:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788651712.145279:0:7451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:0.0:1788651712.145529:0:6505:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788651712.163651:0:6505:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788651712.163788:0:6505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.163811:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c373f expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.163818:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f617ab95/0xcd2f56ea038c3762 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c375b expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.163824:0:6505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003cbd7a90/0xcd2f56ea038c37d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c37cb expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.163830:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.164677:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003cbd7a90/0xcd2f56ea038c37d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c37cb expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.164697:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003cbd7a90/0xcd2f56ea038c37d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c37cb expref: 12 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.164715:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000258791d5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1875537147466240:0@lo:104: 00000100:00100000:1.0:1788651712.164786:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788651712.164873:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f617ab95/0xcd2f56ea038c3762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c375b expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.164882:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f617ab95/0xcd2f56ea038c3762 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c375b expref: 12 pid: 6505 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.164889:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000720d4fa7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1875537147466368:0@lo:104: 00000100:00100000:1.0:1788651712.164940:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788651712.164980:0:6505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c373f expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.164988:0:6505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c373f expref: 12 pid: 6502 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.164995:0:6505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f142120 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1875537147466496:0@lo:104: 00000100:00100000:1.0:1788651712.165013:0:6505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651712.165023:0:6505:0:(client.c:2716:ptlrpc_set_wait()) set 00000000158757be going to sleep for 11 seconds 00000100:00100000:0.0:1788651712.165153:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147466240 00000100:00100000:0.0:1788651712.165162:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147466240 00000100:00100000:3.0:1788651712.165474:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147466368 00000100:00100000:3.0:1788651712.165479:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147466368 00000100:00100000:3.0:1788651712.165501:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147466496 00000100:00100000:3.0:1788651712.165504:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147466496 00000100:00100000:3.0:1788651712.165517:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651712.165524:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b3108e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:6505:x1875537147466240:12345-0@lo:104: 00010000:00010000:3.0:1788651712.165537:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.165612:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788651712.165618:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b3108e7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:6505:x1875537147466240:12345-0@lo:104: Request processed in 94us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651712.165626:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651712.165657:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788651712.165664:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000479766b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6505:x1875537147466368:12345-0@lo:104: 00010000:00010000:3.0:1788651712.165671:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.165721:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788651712.165725:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000479766b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6505:x1875537147466368:12345-0@lo:104: Request processed in 63us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651712.165731:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788651712.165743:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651712.165748:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038614834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6505:x1875537147466496:12345-0@lo:104: 00010000:00010000:3.0:1788651712.165755:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.165780:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788651712.165784:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038614834 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6505:x1875537147466496:12345-0@lo:104: Request processed in 37us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651712.165789:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788651712.166031:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788651712.166037:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.166055:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db199ab3 already unused, calling callback (00000000db8c17d1) 10000000:00010000:2.0:1788651712.166059:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.166066:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651712.166072:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651712.166077:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651712.166106:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.166113:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651712.166132:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.166138:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: 00000000db199ab3/0xcd2f56ea038c37cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37d2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.166149:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788651712.166151:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.166156:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c0cae402 already unused, calling callback (00000000db8c17d1) 10000000:00010000:2.0:1788651712.166158:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.166173:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651712.166177:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651712.166181:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651712.166194:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.166199:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651712.166595:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788651712.166617:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651712.166632:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ebbb0cd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147466624:0@lo:103: 00000100:00100000:1.0:1788651712.166695:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651712.166746:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147466624 00000100:00100000:1.0:1788651712.166752:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147466624 00010000:00010000:1.0:1788651712.166778:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003cbd7a90/0xcd2f56ea038c37d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c37cb expref: 13 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.166801:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788651712.166808:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000218a8132 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:3635:x1875537147466624:12345-0@lo:103: 00010000:00010000:1.0:1788651712.166818:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651712.166822:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003cbd7a90/0xcd2f56ea038c37d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c37cb expref: 13 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.166831:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003cbd7a90/0xcd2f56ea038c37d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c37cb expref: 13 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.166862:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651712.166893:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000218a8132 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:3635:x1875537147466624:12345-0@lo:103: Request processed in 87us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651712.166900:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788651712.166967:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ebbb0cd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147466624:0@lo:103: 00010000:00010000:1.0:1788651712.167096:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003cbd7a90/0xcd2f56ea038c37d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c37cb expref: 12 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.167108:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000258791d5 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1875537147466240:0@lo:104: 00000100:00100000:1.0:1788651712.167115:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000720d4fa7 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1875537147466368:0@lo:104: 00000100:00100000:1.0:1788651712.167123:0:6505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f142120 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6505:1875537147466496:0@lo:104: 00010000:00010000:1.0:1788651712.167138:0:6505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.167236:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651712.167243:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.167251:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006ed1ab35 already unused, calling callback (00000000db8c17d1) 10000000:00010000:1.0:1788651712.167253:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.167261:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651712.167266:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651712.167271:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651712.167292:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.167297:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651712.167316:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.167321:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c373f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3746 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.167330:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651712.167332:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651712.167333:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651712.167337:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651712.167526:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.167534:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c375b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3762 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.167547:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651712.167549:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651712.167551:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651712.167663:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f142120 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147466880:0@lo:103: 00000100:00100000:0.0:1788651712.167701:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651712.167726:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651712.167731:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9a9a96f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147466752:0@lo:103: 00000100:00100000:0.0:1788651712.167751:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651712.167778:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147466880 00000100:00100000:0.0:1788651712.167783:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147466880 00010000:00010000:0.0:1788651712.167802:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c373f expref: 12 pid: 6502 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651712.167820:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147466752 00000100:00100000:0.0:1788651712.167822:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147466752 00010000:00010000:0.0:1788651712.167832:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f617ab95/0xcd2f56ea038c3762 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c375b expref: 13 pid: 6505 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651712.167842:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788651712.167848:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069ffa9f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:3637:x1875537147466880:12345-0@lo:103: 00010000:00010000:0.0:1788651712.167856:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651712.167860:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3746 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c373f expref: 13 pid: 6502 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.167880:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3746 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c373f expref: 13 pid: 6502 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.167892:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c3746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c373f expref: 13 pid: 6502 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.167901:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651712.167947:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069ffa9f4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:3637:x1875537147466880:12345-0@lo:103: Request processed in 99us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651712.167953:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788651712.167968:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788651712.167974:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000299aeee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:3637:x1875537147466752:12345-0@lo:103: 00010000:00010000:0.0:1788651712.167981:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651712.167985:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f617ab95/0xcd2f56ea038c3762 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c375b expref: 11 pid: 6505 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.167992:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f617ab95/0xcd2f56ea038c3762 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c375b expref: 11 pid: 6505 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168001:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f617ab95/0xcd2f56ea038c3762 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c375b expref: 11 pid: 6505 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168011:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168018:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168031:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168044:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168051:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168057:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168062:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001751657c already unused, calling callback (00000000e30859f5) 00010000:00010000:0.0:1788651712.168065:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168072:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168084:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168094:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651712.168117:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000299aeee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:3637:x1875537147466752:12345-0@lo:103: Request processed in 145us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651712.168123:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788651712.168151:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9a9a96f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147466752:0@lo:103: 00000100:00100000:0.0:1788651712.168158:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f142120 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147466880:0@lo:103: 00010000:00010000:0.0:1788651712.168178:0:6505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168186:0:6505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.168197:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001751657c/0xcd2f56ea038c3811 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788651712.168217:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00010000:00010000:1.0:1788651712.169331:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651712.171796:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2a88e77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+9:7439:x1875537147466112:12345-0@lo:253: Request processed in 46377us (47064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651712.171812:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788651712.172094:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053848ac0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147466112:0@lo:253: 10000000:01000000:3.0:1788651712.172110:0:7439:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788651712.172114:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788651712.172116:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788651712.172117:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788651712.172118:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:3.0:1788651712.172119:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788651712.172120:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788651712.172121:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788651712.172123:0:7439:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788651712.172124:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788651712.172126:0:7439:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788651712.172147:0:7439:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000011df1cb7 from lustre-MDT0001 10000000:01000000:3.0:1788651712.172175:0:7439:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788651712.172177:0:7439:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788651712.172184:0:7439:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f86da6c3380 local copy 10000000:01000000:3.0:1788651712.172334:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788651712.172684:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.172695:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.172704:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651712.172724:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000717c9ce7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467008:0@lo:101: 00000100:00100000:3.0:1788651712.172770:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651712.172871:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc26b9fe going to sleep for 11 seconds 00000100:00100000:0.0:1788651712.173488:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147467008 00000100:00100000:0.0:1788651712.173497:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147467008 00000100:00100000:0.0:1788651712.173593:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788651712.173603:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006acec293 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+9:7439:x1875537147467008:12345-0@lo:101: 00010000:00010000:0.0:1788651712.173618:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651712.173634:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a751466/0xcd2f56ea038c381f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3818 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.173674:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a751466/0xcd2f56ea038c381f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3818 expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.173687:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a751466/0xcd2f56ea038c381f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3818 expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.173697:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a751466, rc 0) 00000100:00100000:0.0:1788651712.173758:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006acec293 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:7439:x1875537147467008:12345-0@lo:101: Request processed in 156us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651712.173765:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788651712.173857:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000717c9ce7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467008:0@lo:101: 00010000:00010000:3.0:1788651712.173872:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.173882:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651712.174023:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000717c9ce7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467136:0@lo:501: 00000100:00100000:3.0:1788651712.174057:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651712.175919:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fc26b9fe going to sleep for 11 seconds 00000100:00100000:1.0:1788651712.177055:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147467136 00000100:00100000:1.0:1788651712.177068:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147467136 00000100:00100000:1.0:1788651712.177138:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788651712.177147:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a0e6fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:7439:x1875537147467136:12345-0@lo:501: 00000100:00100000:1.0:1788651712.179466:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a0e6fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:7439:x1875537147467136:12345-0@lo:501: Request processed in 2312us (5399us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788651712.179482:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788651712.179777:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000717c9ce7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467136:0@lo:501: 10000000:01000000:3.0:1788651712.179800:0:7439:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788651712.179834:0:7439:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788651712.179854:0:7439:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.179884:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.179891:0:7439:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.179937:0:7439:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788651712.180115:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f86f48d9800 10000000:01000000:3.0:1788651712.180121:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788651712.180126:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f86da6c3380 10000000:01000000:3.0:1788651712.180129:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788651712.180132:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f86da6c3380 from 1 10000000:01000000:3.0:1788651712.180135:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788651712.180165:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 000000001a431d3f/0xcd2f56ea038c3826 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.180172:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 000000001a431d3f/0xcd2f56ea038c3826 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.180182:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 000000001a431d3f/0xcd2f56ea038c3826 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651712.180201:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000717c9ce7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467264:0@lo:101: 00000100:00100000:3.0:1788651712.180258:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651712.180309:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 000000006a432a19 going to sleep for 11 seconds 00000100:00100000:2.0:1788651712.180433:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147467264 00000100:00100000:2.0:1788651712.180441:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147467264 00000100:00100000:2.0:1788651712.180489:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788651712.180497:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffa180d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:7439:x1875537147467264:12345-0@lo:101: 00010000:00010000:2.0:1788651712.180508:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651712.180521:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000072b980c3/0xcd2f56ea038c382d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3826 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.180542:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000072b980c3/0xcd2f56ea038c382d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3826 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.180560:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000072b980c3/0xcd2f56ea038c382d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3826 expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.180568:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000072b980c3, rc 0) 00000100:00100000:2.0:1788651712.180608:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffa180d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:7439:x1875537147467264:12345-0@lo:101: Request processed in 112us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.180614:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788651712.180673:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000717c9ce7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467264:0@lo:101: 00010000:00010000:2.0:1788651712.180685:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 000000001a431d3f/0xcd2f56ea038c3826 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c382d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.180693:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 000000001a431d3f/0xcd2f56ea038c3826 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c382d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651712.180709:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788651712.180718:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 000000001a431d3f/0xcd2f56ea038c3826 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c382d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.180725:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 000000001a431d3f/0xcd2f56ea038c3826 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c382d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651712.180731:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f86f48d9800 10000000:01000000:2.0:1788651712.180735:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788651712.180737:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f86f48d9800 from 1 10000000:01000000:2.0:1788651712.180739:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788651712.180754:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 000000004c204db4/0xcd2f56ea038c3834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.180769:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 000000004c204db4/0xcd2f56ea038c3834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.180776:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 000000004c204db4/0xcd2f56ea038c3834 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651712.180789:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467392:0@lo:101: 00000100:00100000:2.0:1788651712.180813:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.180827:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d13a3ca going to sleep for 11 seconds 00000100:00100000:2.0:1788651712.180860:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147467392 00000100:00100000:2.0:1788651712.180863:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147467392 00000100:00100000:2.0:1788651712.180882:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788651712.180888:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c189c215 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:7439:x1875537147467392:12345-0@lo:101: 00010000:00010000:2.0:1788651712.180894:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651712.180901:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d748087c/0xcd2f56ea038c383b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3834 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.180946:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d748087c/0xcd2f56ea038c383b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3834 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.180966:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d748087c/0xcd2f56ea038c383b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3834 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.180972:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d748087c, rc 0) 00000100:00100000:2.0:1788651712.181000:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c189c215 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:7439:x1875537147467392:12345-0@lo:101: Request processed in 112us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.181005:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788651712.181046:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467392:0@lo:101: 00010000:00010000:2.0:1788651712.181061:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 000000004c204db4/0xcd2f56ea038c3834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.181067:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 000000004c204db4/0xcd2f56ea038c3834 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651712.181076:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788651712.181083:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 000000004c204db4/0xcd2f56ea038c3834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.181089:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 000000004c204db4/0xcd2f56ea038c3834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651712.181094:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788651712.181097:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788651712.181101:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f86f48d9800 10000000:01000000:2.0:1788651712.181103:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788651712.181106:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1788651712.181108:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788651712.181119:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 000000003dfadbed/0xcd2f56ea038c3842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.181126:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 000000003dfadbed/0xcd2f56ea038c3842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.181132:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 000000003dfadbed/0xcd2f56ea038c3842 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651712.181142:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467520:0@lo:101: 00000100:00100000:2.0:1788651712.181167:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.181191:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d13a3ca going to sleep for 11 seconds 00000100:00100000:2.0:1788651712.181208:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147467520 00000100:00100000:2.0:1788651712.181211:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147467520 00000100:00100000:2.0:1788651712.181230:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788651712.181235:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000070280f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:7439:x1875537147467520:12345-0@lo:101: 00010000:00010000:2.0:1788651712.181241:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651712.181248:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000018ea29e4/0xcd2f56ea038c3849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3842 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.181259:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000018ea29e4/0xcd2f56ea038c3849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3842 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.181265:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000018ea29e4/0xcd2f56ea038c3849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3842 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.181271:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000018ea29e4, rc 0) 00000100:00100000:2.0:1788651712.181297:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000070280f5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147467520:12345-0@lo:101: Request processed in 62us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.181302:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788651712.181332:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467520:0@lo:101: 00010000:00010000:2.0:1788651712.181341:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 000000003dfadbed/0xcd2f56ea038c3842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.181359:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 000000003dfadbed/0xcd2f56ea038c3842 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651712.181435:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467648:0@lo:501: 00000100:00100000:2.0:1788651712.181458:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.181469:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d13a3ca going to sleep for 11 seconds 00000100:00100000:2.0:1788651712.181487:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147467648 00000100:00100000:2.0:1788651712.181490:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147467648 00000100:00100000:2.0:1788651712.181505:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788651712.181510:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6d1d469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147467648:12345-0@lo:501: 00000100:00100000:2.0:1788651712.181601:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6d1d469 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147467648:12345-0@lo:501: Request processed in 90us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.181608:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788651712.181634:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467648:0@lo:501: 00000100:00100000:2.0:1788651712.181667:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467776:0@lo:503: 00000100:00100000:2.0:1788651712.181702:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.181713:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d13a3ca going to sleep for 11 seconds 00000100:00100000:2.0:1788651712.181724:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147467776 00000100:00100000:2.0:1788651712.181727:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147467776 00000100:00100000:2.0:1788651712.181741:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788651712.181746:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c9cde5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147467776:12345-0@lo:503: 00000100:00100000:2.0:1788651712.181809:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c9cde5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147467776:12345-0@lo:503: Request processed in 63us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.181815:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788651712.181850:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467776:0@lo:503: 00000040:00080000:2.0:1788651712.182096:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788651712.182166:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467904:0@lo:502: 00000100:00100000:2.0:1788651712.182197:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.182218:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054db2db4 going to sleep for 11 seconds 00000100:00100000:2.0:1788651712.182232:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147467904 00000100:00100000:2.0:1788651712.182235:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147467904 00000100:00100000:2.0:1788651712.182254:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788651712.182259:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f5cdbda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147467904:12345-0@lo:502: 00000100:00100000:2.0:1788651712.182338:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f5cdbda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147467904:12345-0@lo:502: Request processed in 76us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.182344:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788651712.182380:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147467904:0@lo:502: 00000040:00080000:2.0:1788651712.182568:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788651712.182594:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1788651712.182609:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1788651712.182622:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1788651712.182634:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1788651712.182672:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1788651712.182689:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1788651712.182702:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1788651712.182716:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1788651712.182729:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1788651712.182743:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1788651712.182761:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1788651712.182773:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1788651712.182783:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1788651712.182793:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1788651712.182804:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1788651712.182814:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1788651712.182824:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1788651712.182834:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1788651712.182844:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1788651712.182856:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1788651712.182881:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1788651712.182895:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1788651712.182942:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147468032:0@lo:502: 00000100:00100000:2.0:1788651712.182974:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.182996:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 0000000054db2db4 going to sleep for 11 seconds 00000100:00100000:2.0:1788651712.183015:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147468032 00000100:00100000:2.0:1788651712.183018:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147468032 00000100:00100000:2.0:1788651712.183036:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788651712.183041:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000061f35440 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147468032:12345-0@lo:502: 00000100:00100000:2.0:1788651712.183103:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000061f35440 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147468032:12345-0@lo:502: Request processed in 62us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.183109:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788651712.183142:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147468032:0@lo:502: 00000040:00080000:2.0:1788651712.183172:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1788651712.183178:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00010000:00010000:1.0:1788651712.183968:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651712.183977:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.183986:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000610d8455 already unused, calling callback (00000000db8c17d1) 10000000:00010000:1.0:1788651712.183989:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.183998:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651712.184006:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651712.184011:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651712.184041:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.184047:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651712.184087:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.184093:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c3818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd2f56ea038c381f expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651712.184218:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000720d4fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147468160:0@lo:103: 00000100:00100000:3.0:1788651712.184264:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788651712.185794:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651712.185801:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651712.185804:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651712.186132:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147468160 00000100:00100000:1.0:1788651712.186141:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147468160 00000100:00100000:1.0:1788651712.186197:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651712.186219:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035356488 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:3635:x1875537147468160:12345-0@lo:103: 00010000:00010000:1.0:1788651712.186234:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651712.186253:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005a751466/0xcd2f56ea038c381f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3818 expref: 13 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.186268:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651712.186501:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035356488 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:3635:x1875537147468160:12345-0@lo:103: Request processed in 283us (2236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651712.186508:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788651712.186601:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000720d4fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147468160:0@lo:103: 00000020:01000000:0.0:1788651712.187625:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651712.187650:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651712.187654:0:7453:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788651712.187660:0:7453:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:0.0:1788651712.187663:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788651712.187680:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000865c1410) 00000020:00000080:0.0:1788651712.187701:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:0.0:1788651712.187717:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788651712.187788:0:7453:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788651712.187796:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c3857 00000020:00000080:0.0:1788651712.188566:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:0.0:1788651712.188573:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651712.188578:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651712.188579:0:7453:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:0.0:1788651712.188582:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651712.188586:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651712.188587:0:7453:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:0.0:1788651712.188591:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788651712.188599:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (0000000035529589) 00000020:00000080:0.0:1788651712.188613:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:0.0:1788651712.188617:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788651712.188619:0:7453:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:0.0:1788651712.188621:0:7453:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:0.0:1788651712.188627:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788651712.188701:0:7453:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000011df1cb7 from lustre-MDT0001, refs=2 00000020:00000080:0.0:1788651712.188714:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (00000000397bff8f) 00000020:00000080:0.0:1788651712.188731:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:0.0:1788651712.188794:0:7453:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788651712.188801:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c386c 00000020:00000080:0.0:1788651712.189275:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:0.0:1788651712.189284:0:7453:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788651712.189291:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcd2f56ea038c3873 00080000:01000000:0.0:1788651712.189627:0:7453:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788651712.189633:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c387a 00080000:10000000:0.0:1788651712.192424:0:7453:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788651712.192651:0:7453:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:1.0:1788651712.353600:0:7453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:1.0:1788651712.354352:0:7453:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:1.0:1788651712.359754:0:7453:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1788651712.360731:0:7453:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788651712.380971:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788651712.380985:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651712.380992:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651712.380994:0:7453:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788651712.380997:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651712.381002:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651712.381003:0:7453:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788651712.381006:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788651712.381011:0:7453:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:00000080:3.0:1788651712.381037:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788651712.381061:0:7453:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000026f30a14) 00000020:00000080:3.0:1788651712.381082:0:7453:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788651712.381088:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788651712.381192:0:7453:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788651712.381199:0:7453:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788651712.381206:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c3888 00010000:00080000:3.0:1788651712.381249:0:7453:0:(ldlm_lib.c:102:import_set_conn()) imp 000000008a0ccd9e@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:3.0:1788651712.382756:0:7453:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:2.0:1788651712.388649:0:7453:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788651712.388664:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788651712.388705:0:7453:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788651712.388734:0:7453:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c388f 00000100:00080000:2.0:1788651712.388745:0:7453:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788651712.388750:0:7453:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000008a0ccd9e using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788651712.388787:0:7453:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000096b0a30a x1875537147468288/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788651712.388822:0:7453:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788651712.388874:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651712.388878:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651712.388879:0:7453:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788651712.388882:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788651712.388885:0:7453:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788651712.388886:0:7453:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788651712.388888:0:7453:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788651712.388889:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788651712.388891:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651712.388892:0:7453:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788651712.388895:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651712.388905:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651712.388923:0:7453:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000100:00100000:1.0:1788651712.388927:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000258791d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147468416:0@lo:400: 00000020:00000080:2.0:1788651712.388928:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788651712.388972:0:7453:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788651712.388986:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651712.388989:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00100000:1.0:1788651712.388989:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788651712.388990:0:7453:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788651712.388992:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651712.388995:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651712.388995:0:7453:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788651712.388998:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788651712.388999:0:7453:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788651712.389022:0:7453:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651712.389024:0:7453:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651712.389025:0:7453:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788651712.389028:0:7453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:1.0:1788651712.389072:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147468416 00000020:01000000:2.0:1788651712.389074:0:7439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 00000100:00100000:1.0:1788651712.389079:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147468416 10000000:01000000:2.0:1788651712.389102:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788651712.389115:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 000000003dfadbed/0xcd2f56ea038c3842 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.389121:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788651712.389125:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 000000003dfadbed/0xcd2f56ea038c3842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.389128:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c6d47b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147468416:12345-0@lo:400: 10000000:01000000:2.0:1788651712.389132:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86f48d9800 from 1 10000000:01000000:2.0:1788651712.389134:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788651712.389155:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.389163:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.389173:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c6d47b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147468416:12345-0@lo:400: Request processed in 46us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651712.389179:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788651712.389183:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651712.389196:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007df1a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147468544:0@lo:101: 00010000:00080000:1.0:1788651712.389211:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000258791d5 x1875537147468416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651728 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651712.389223:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000258791d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147468416:0@lo:400: 00000100:00100000:2.0:1788651712.389345:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.389370:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019592ab8 going to sleep for 11 seconds 00000100:00100000:2.0:1788651712.389394:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147468544 00000100:00100000:2.0:1788651712.389398:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147468544 00000100:00100000:2.0:1788651712.389429:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788651712.389436:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e6b2108 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+12:7439:x1875537147468544:12345-0@lo:101: 00010000:00010000:2.0:1788651712.389444:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651712.389455:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d6ef563c/0xcd2f56ea038c389d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3896 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.389474:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d6ef563c/0xcd2f56ea038c389d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3896 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.389483:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d6ef563c/0xcd2f56ea038c389d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3896 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.389490:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d6ef563c, rc 0) 00000100:00100000:2.0:1788651712.389518:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e6b2108 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147468544:12345-0@lo:101: Request processed in 83us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.389523:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788651712.389555:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007df1a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147468544:0@lo:101: 00010000:00010000:2.0:1788651712.389567:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.389585:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651712.390993:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147468288:0@lo:38: 00000100:00100000:3.0:1788651712.391052:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651712.391240:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147468288 00000100:00100000:1.0:1788651712.391247:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147468288 00000100:00100000:1.0:1788651712.391287:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651712.391291:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a91bbe17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147468288:12345-0@lo:38: 00010000:00080000:1.0:1788651712.391318:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:1.0:1788651712.391353:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c38a4 00000004:00100000:1.0:1788651712.391370:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788651712.391375:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788651712.393567:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007df1a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147468672:0@lo:256: 00000100:00100000:2.0:1788651712.393661:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.393716:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019592ab8 going to sleep for 11 seconds 00000100:00100000:3.0:1788651712.393973:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147468672 00000100:00100000:3.0:1788651712.393981:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147468672 00000100:00100000:3.0:1788651712.394030:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788651712.394038:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000030aed1ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147468672:12345-0@lo:256: 20000000:01000000:3.0:1788651712.394128:0:6502:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788651712.394772:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788651712.394777:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788651712.395300:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000030aed1ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147468672:12345-0@lo:256: Request processed in 1259us (1637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651712.395311:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788651712.395408:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007df1a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147468672:0@lo:256: 10000000:01000000:2.0:1788651712.396764:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788651712.396792:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.396813:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651712.396823:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86f48d9800 from 1 10000000:01000000:2.0:1788651712.396825:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788651712.397108:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.397116:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.397125:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651712.397146:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007df1a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147468800:0@lo:101: 00000100:00100000:2.0:1788651712.397204:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.397291:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 0000000019592ab8 going to sleep for 11 seconds 00000100:00100000:0.0:1788651712.397713:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147468800 00000100:00100000:0.0:1788651712.397722:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147468800 00000100:00100000:0.0:1788651712.397996:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788651712.398006:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8077ead pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:7439:x1875537147468800:12345-0@lo:101: 00010000:00010000:0.0:1788651712.398026:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651712.398039:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003126b5e5/0xcd2f56ea038c38b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c38ab expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.398130:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003126b5e5/0xcd2f56ea038c38b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c38ab expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.398142:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003126b5e5/0xcd2f56ea038c38b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c38ab expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.398150:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003126b5e5, rc 0) 00000100:00100000:0.0:1788651712.398204:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8077ead pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:7439:x1875537147468800:12345-0@lo:101: Request processed in 199us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651712.398210:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788651712.398299:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007df1a1a pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147468800:0@lo:101: 00010000:00010000:1.0:1788651712.398314:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.398323:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.398422:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000258791d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147468928:0@lo:501: 00000100:00100000:1.0:1788651712.398454:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651712.398485:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dd893095 going to sleep for 11 seconds 00000100:00100000:3.0:1788651712.398491:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147468928 00000100:00100000:3.0:1788651712.398496:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147468928 00000100:00100000:3.0:1788651712.398532:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788651712.398538:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0e4d2ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:7439:x1875537147468928:12345-0@lo:501: 00000100:00100000:3.0:1788651712.398651:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0e4d2ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:7439:x1875537147468928:12345-0@lo:501: Request processed in 113us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651712.398659:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788651712.398712:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000258791d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147468928:0@lo:501: 00000100:00100000:2.0:1788651712.398743:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000221bfc20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469056:0@lo:503: 00000100:00100000:2.0:1788651712.398780:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.398799:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 000000005e912598 going to sleep for 11 seconds 00000100:00100000:0.0:1788651712.399174:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147469056 00000100:00100000:0.0:1788651712.399179:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147469056 00000100:00100000:0.0:1788651712.399203:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788651712.399209:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007563e159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:7439:x1875537147469056:12345-0@lo:503: 00000040:00080000:0.0:1788651712.399245:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788651712.399295:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007563e159 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:7439:x1875537147469056:12345-0@lo:503: Request processed in 87us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651712.399303:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788651712.399382:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000221bfc20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469056:0@lo:503: 00000040:00080000:2.0:1788651712.399668:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651712.399715:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1788651712.399787:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1788651712.403384:0:6514:0:(import.c:65:import_set_state_nolock()) 0000000044803022 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788651712.403479:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a91bbe17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875537147468288:12345-0@lo:38: Request processed in 12185us (12426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651712.403494:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788651712.403699:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788651712.403708:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788651712.403716:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788651712.403721:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788651712.403724:0:3634:0:(import.c:65:import_set_state_nolock()) 000000008a0ccd9e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788651712.403742:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000096b0a30a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147468288:0@lo:38: 00000100:00100000:3.0:1788651712.403905:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651712.403937:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147469184:0@lo:41: 00000100:00100000:3.0:1788651712.404077:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.404166:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147469184 00000100:00100000:2.0:1788651712.404173:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147469184 00000100:00100000:2.0:1788651712.404212:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788651712.404233:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018521a1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875537147469184:12345-0@lo:41: 00000004:00000024:2.0:1788651712.404262:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788651712.404302:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018521a1f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3638:x1875537147469184:12345-0@lo:41: Request processed in 72us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.404308:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651712.404484:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147469184:0@lo:41: 00000040:00080000:1.0:1788651712.406266:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1788651712.406657:0:7439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788651712.406693:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788651712.406721:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.406733:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651712.406787:0:7439:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788651712.406790:0:7439:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f86f48d9800 10000000:01000000:3.0:1788651712.406793:0:7439:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f86f48d9800 10000000:01000000:3.0:1788651712.406798:0:7439:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788651712.406804:0:7439:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86f48d9800 from 1 10000000:01000000:3.0:1788651712.406807:0:7439:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788651712.406871:0:7439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 0000000046ca9aa8/0xcd2f56ea038c38b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.406880:0:7439:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 0000000046ca9aa8/0xcd2f56ea038c38b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.406890:0:7439:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 0000000046ca9aa8/0xcd2f56ea038c38b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651712.406934:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469312:0@lo:101: 00000100:00100000:3.0:1788651712.407072:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651712.407116:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032264422 going to sleep for 11 seconds 00000100:00100000:0.0:1788651712.407201:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147469312 00000100:00100000:0.0:1788651712.407211:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147469312 00000100:00100000:0.0:1788651712.407274:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788651712.407282:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000087709a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:7439:x1875537147469312:12345-0@lo:101: 00010000:00010000:0.0:1788651712.407294:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651712.407306:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009832cb2d/0xcd2f56ea038c38c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c38b9 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.407348:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009832cb2d/0xcd2f56ea038c38c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c38b9 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.407358:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009832cb2d/0xcd2f56ea038c38c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c38b9 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651712.407366:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009832cb2d, rc 0) 00000100:00100000:0.0:1788651712.407411:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000087709a22 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7439:x1875537147469312:12345-0@lo:101: Request processed in 130us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651712.407420:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788651712.408430:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469312:0@lo:101: 00010000:00010000:3.0:1788651712.408502:0:7439:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 0000000046ca9aa8/0xcd2f56ea038c38b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651712.408512:0:7439:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 0000000046ca9aa8/0xcd2f56ea038c38b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651712.408647:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469440:0@lo:501: 00000100:00100000:3.0:1788651712.408695:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651712.408731:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032264422 going to sleep for 11 seconds 00000100:00100000:1.0:1788651712.409219:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147469440 00000100:00100000:1.0:1788651712.409227:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147469440 00000100:00100000:1.0:1788651712.409271:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788651712.409279:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3939331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7439:x1875537147469440:12345-0@lo:501: 00000100:00100000:1.0:1788651712.409420:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3939331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7439:x1875537147469440:12345-0@lo:501: Request processed in 142us (725us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651712.409428:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788651712.409813:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469440:0@lo:501: 00000100:00100000:3.0:1788651712.409849:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469568:0@lo:503: 00000100:00100000:3.0:1788651712.409901:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651712.410024:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032264422 going to sleep for 11 seconds 00000100:00100000:2.0:1788651712.410124:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147469568 00000100:00100000:2.0:1788651712.410130:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147469568 00000100:00100000:2.0:1788651712.410167:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788651712.410173:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036e1949f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7439:x1875537147469568:12345-0@lo:503: 00000100:00100000:2.0:1788651712.410271:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036e1949f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7439:x1875537147469568:12345-0@lo:503: Request processed in 98us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.410278:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788651712.410517:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469568:0@lo:503: 00000040:00080000:3.0:1788651712.410814:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788651712.410904:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469696:0@lo:502: 00000100:00100000:3.0:1788651712.411373:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651712.411436:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032264422 going to sleep for 11 seconds 00000100:00100000:1.0:1788651712.411482:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147469696 00000100:00100000:1.0:1788651712.411488:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147469696 00000100:00100000:1.0:1788651712.411552:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788651712.411561:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069de4f2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7439:x1875537147469696:12345-0@lo:502: 00000100:00100000:1.0:1788651712.411672:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069de4f2c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7439:x1875537147469696:12345-0@lo:502: Request processed in 113us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651712.411680:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788651712.411750:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469696:0@lo:502: 00000040:00080000:3.0:1788651712.411988:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788651712.412016:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788651712.412032:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788651712.412045:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788651712.412058:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788651712.412071:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788651712.412083:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788651712.412095:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788651712.412121:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788651712.412136:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788651712.412150:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788651712.412162:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788651712.412173:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788651712.412186:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788651712.412212:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788651712.412226:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788651712.412239:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788651712.412251:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788651712.412263:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788651712.412276:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788651712.412289:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788651712.412319:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788651712.412332:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788651712.412346:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788651712.412359:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788651712.412371:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788651712.412383:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788651712.412408:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:3.0:1788651712.412438:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469824:0@lo:502: 00000100:00100000:3.0:1788651712.412481:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651712.413260:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032264422 going to sleep for 11 seconds 00000100:00100000:0.0:1788651712.413401:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147469824 00000100:00100000:0.0:1788651712.413410:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147469824 00000100:00100000:0.0:1788651712.413454:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788651712.413462:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060754986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7439:x1875537147469824:12345-0@lo:502: 00000100:00100000:0.0:1788651712.413604:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060754986 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7439:x1875537147469824:12345-0@lo:502: Request processed in 142us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651712.413612:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788651712.413684:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147469824:0@lo:502: 00000040:00080000:3.0:1788651712.413750:0:7439:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788651712.413761:0:7439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788651712.414771:0:7459:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788651712.414786:0:7459:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (00000000f07bafe9) 00000020:00000080:3.0:1788651712.415172:0:7459:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788651712.415370:0:7459:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000011df1cb7 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788651712.415374:0:7459:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000011df1cb7 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788651712.415377:0:7459:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000011df1cb7 3 00010000:00080000:3.0:1788651712.415405:0:7459:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000067071d57@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:3.0:1788651712.418485:0:7459:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:3.0:1788651712.418734:0:7459:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788651712.418775:0:7459:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788651712.418787:0:7459:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcd2f56ea038c38ce 00000100:00080000:3.0:1788651712.418798:0:7459:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788651712.418803:0:7459:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000067071d57 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788651712.418839:0:7459:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000024ebb513 x1875537147469952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788651712.418864:0:7459:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788651712.419012:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147469952:0@lo:38: 00000040:00080000:1.0:1788651712.419552:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1788651712.419596:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788651712.419660:0:7439:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788651712.419686:0:7439:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788651712.419708:0:7439:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 0000000046ca9aa8/0xcd2f56ea038c38b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.419719:0:7439:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 0000000046ca9aa8/0xcd2f56ea038c38b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788651712.419776:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788651712.419779:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788651712.419781:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788651712.419782:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788651712.419783:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788651712.419785:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788651712.419786:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788651712.419787:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 40000000:00080000:3.0:1788651712.419788:0:7460:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000004:2.0:1788651712.419789:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788651712.419790:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788651712.419791:0:7439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788651712.419795:0:7439:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:2.0:1788651712.419797:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788651712.419799:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788651712.419800:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788651712.419801:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788651712.419802:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788651712.419803:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788651712.419803:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788651712.419804:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788651712.419805:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788651712.419811:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788651712.419811:0:7439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788651712.419836:0:7439:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788651712.420041:0:7439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000221bfc20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147470080:0@lo:253: 00000100:00100000:2.0:1788651712.420153:0:7439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.420190:0:7439:0:(client.c:2716:ptlrpc_set_wait()) set 000000004ff6e133 going to sleep for 11 seconds 00000100:00100000:1.0:1788651712.420190:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147470080 00000100:00100000:1.0:1788651712.420196:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147470080 00000100:00100000:1.0:1788651712.420254:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788651712.420263:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a026985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7439:x1875537147470080:12345-0@lo:253: 20000000:01000000:1.0:1788651712.420404:0:6502:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788651712.420420:0:6502:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788651712.422443:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788651712.423027:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147469952 00000100:00100000:0.0:1788651712.423040:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147469952 00000100:00100000:0.0:1788651712.423156:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788651712.423163:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000096b0a30a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147469952:12345-0@lo:38: 00010000:00080000:0.0:1788651712.423191:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:0.0:1788651712.423230:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcd2f56ea038c38d5 00000004:00100000:0.0:1788651712.423249:0:6509:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788651712.423285:0:6509:0:(import.c:65:import_set_state_nolock()) 0000000092ef1669 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651712.423681:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000096b0a30a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875537147469952:12345-0@lo:38: Request processed in 516us (4084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651712.423696:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788651712.423983:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000024ebb513 x1875537147469952/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788651722 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651712.423995:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788651712.424005:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1788651712.424012:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788651712.424018:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788651712.424020:0:3634:0:(import.c:65:import_set_state_nolock()) 0000000067071d57 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788651712.424026:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000024ebb513 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147469952:0@lo:38: 20000000:01000000:1.0:1788651712.424090:0:6502:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788651712.424111:0:6502:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788651712.424232:0:6525:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788651712.424238:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788651712.424257:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.424272:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002661fa2d/0xcd2f56ea038c37fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c37ee expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.424285:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d6ef563c/0xcd2f56ea038c389d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3896 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.424303:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.424337:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d6ef563c/0xcd2f56ea038c389d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3896 expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.424351:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d6ef563c/0xcd2f56ea038c389d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3896 expref: 15 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.424364:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000649e3f75 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147470208:0@lo:104: 00000100:00100000:1.0:1788651712.424406:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788651712.424465:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002661fa2d/0xcd2f56ea038c37fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c37ee expref: 15 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.424472:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002661fa2d/0xcd2f56ea038c37fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c37ee expref: 15 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.424480:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009daaffe pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147470336:0@lo:104: 00000100:00100000:1.0:1788651712.424500:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651712.424524:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a52f1a9f going to sleep for 11 seconds 00000100:00100000:2.0:1788651712.424881:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147470208 00000100:00100000:2.0:1788651712.424888:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147470208 00000100:00100000:2.0:1788651712.424938:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147470336 00000100:00100000:2.0:1788651712.424941:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147470336 00000100:00100000:2.0:1788651712.424964:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788651712.424971:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000039feedeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6525:x1875537147470208:12345-0@lo:104: 00010000:00010000:2.0:1788651712.424983:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425036:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788651712.425041:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000039feedeb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6525:x1875537147470208:12345-0@lo:104: Request processed in 72us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.425047:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788651712.425062:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788651712.425068:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c1bf232 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6525:x1875537147470336:12345-0@lo:104: 00010000:00010000:2.0:1788651712.425074:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425116:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788651712.425120:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c1bf232 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6525:x1875537147470336:12345-0@lo:104: Request processed in 54us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.425126:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788651712.425142:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788651712.425153:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425159:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000087ab8029 already unused, calling callback (00000000db8c17d1) 10000000:00010000:2.0:1788651712.425162:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425169:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651712.425175:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651712.425181:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651712.425204:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425210:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651712.425238:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425245:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: 0000000087ab8029/0xcd2f56ea038c3896 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c389d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425255:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651712.425257:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425262:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f37f858 already unused, calling callback (00000000db8c17d1) 10000000:00010000:2.0:1788651712.425264:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425280:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651712.425285:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651712.425451:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651712.425466:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425472:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651712.425484:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425489:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: 000000006f37f858/0xcd2f56ea038c37ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37fc expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425504:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651712.425506:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651712.425507:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651712.425521:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000772ef606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147470464:0@lo:103: 00000100:00100000:2.0:1788651712.425550:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.425590:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147470464 00000100:00100000:2.0:1788651712.425595:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147470464 00010000:00010000:2.0:1788651712.425611:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d6ef563c/0xcd2f56ea038c389d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3896 expref: 16 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651712.425630:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788651712.425648:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8149c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:3638:x1875537147470464:12345-0@lo:103: 00010000:00010000:2.0:1788651712.425664:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651712.425669:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d6ef563c/0xcd2f56ea038c389d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3896 expref: 16 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425677:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d6ef563c/0xcd2f56ea038c389d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3896 expref: 16 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651712.425692:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651712.425718:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8149c8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:3638:x1875537147470464:12345-0@lo:103: Request processed in 72us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651712.425725:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788651712.425756:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000772ef606 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147470464:0@lo:103: 00010000:00010000:1.0:1788651712.426188:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651712.426199:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015553787 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147470592:0@lo:103: 00000100:00100000:1.0:1788651712.426241:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651712.426302:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147470592 00000100:00100000:1.0:1788651712.426307:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147470592 00010000:00010000:1.0:1788651712.426329:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002661fa2d/0xcd2f56ea038c37fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c37ee expref: 16 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.426355:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788651712.426361:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9ef5b2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:3635:x1875537147470592:12345-0@lo:103: 00010000:00010000:1.0:1788651712.426369:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651712.426372:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002661fa2d/0xcd2f56ea038c37fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c37ee expref: 16 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426380:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002661fa2d/0xcd2f56ea038c37fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c37ee expref: 16 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426393:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426399:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788651712.426412:0:6495:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014503933s 00010000:00010000:1.0:1788651712.426416:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426423:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426429:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426434:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426440:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f2fda1c9 already unused, calling callback (00000000e30859f5) 00010000:00010000:1.0:1788651712.426447:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426454:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426462:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426471:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651712.426501:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9ef5b2a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:3635:x1875537147470592:12345-0@lo:103: Request processed in 141us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651712.426507:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788651712.426559:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a026985 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7439:x1875537147470080:12345-0@lo:253: Request processed in 6298us (6407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651712.426567:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:1.0:1788651712.426570:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d6ef563c/0xcd2f56ea038c389d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3896 expref: 15 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.426580:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000649e3f75 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147470208:0@lo:104: 00010000:00010000:1.0:1788651712.426590:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002661fa2d/0xcd2f56ea038c37fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c37ee expref: 13 pid: 6504 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651712.426597:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009daaffe pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147470336:0@lo:104: 00010000:00010000:1.0:1788651712.426610:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426617:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426622:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651712.426627:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c38dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651712.427210:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015553787 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147470592:0@lo:103: 00000100:00100000:0.0:1788651712.427378:0:7439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000221bfc20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7439:1875537147470080:0@lo:253: 10000000:01000000:0.0:1788651712.427389:0:7439:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788651712.427392:0:7439:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788651712.427393:0:7439:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788651712.427395:0:7439:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651712.427395:0:7439:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788651712.427397:0:7439:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651712.427398:0:7439:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651712.427399:0:7439:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788651712.427400:0:7439:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788651712.427402:0:7439:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788651712.427403:0:7439:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651712.427404:0:7439:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788651712.427417:0:7439:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788651712.432788:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1788651712.432969:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788651712.433145:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788651712.433296:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788651712.433531:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788651712.433685:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1788651712.437231:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1788651712.437513:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1788651712.437744:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1788651712.437937:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1788651712.438746:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1788651712.439363:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:2.0:1788651712.443450:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788651712.443981:0:7464:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788651712.443986:0:7464:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788651712.444097:0:7465:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788651712.444149:0:7465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000772ef606 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7465:1875537147470720:0@lo:700: 00000100:00100000:2.0:1788651712.444214:0:7465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.444267:0:7465:0:(client.c:2716:ptlrpc_set_wait()) set 0000000088dc4ce2 going to sleep for 11 seconds 00000100:00100000:0.0:1788651712.444393:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147470720 00000100:00100000:0.0:1788651712.444401:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147470720 00000100:00100000:0.0:1788651712.444452:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788651712.444460:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085b50719 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7465:x1875537147470720:12345-0@lo:700: 00000040:01000000:3.0:1788651712.444652:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:3.0:1788651712.449785:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e81e8d3f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875537147470848:0@lo:1000: 00000100:00100000:3.0:1788651712.449855:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651712.449920:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9aa4336 going to sleep for 11 seconds 00000100:00100000:0.0:1788651712.450013:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147470848 00000100:00100000:0.0:1788651712.450022:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147470848 00000100:00100000:0.0:1788651712.450100:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788651712.450109:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008a322cbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1875537147470848:12345-0@lo:1000: 00000100:00100000:0.0:1788651712.450199:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008a322cbe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1875537147470848:12345-0@lo:1000: Request processed in 91us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651712.450206:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 40000000:02000000:3.0:1788651712.450789:0:6516:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:1.0:1788651712.451114:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e81e8d3f pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875537147470848:0@lo:1000: 00000040:01000000:1.0:1788651712.451150:0:7466:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:1.0:1788651712.451186:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009daaffe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875537147470976:0@lo:700: 00000100:00100000:1.0:1788651712.451225:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651712.451263:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147470976 00000100:00100000:1.0:1788651712.451268:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147470976 00000100:00100000:1.0:1788651712.451302:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651712.451309:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000649e3f75 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875537147470976:12345-0@lo:700: 00000100:00100000:1.0:1788651712.451353:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000649e3f75 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875537147470976:12345-0@lo:700: Request processed in 45us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651712.451360:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651712.451382:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f272998f going to sleep for 11 seconds 00000100:00100000:1.0:1788651712.451396:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009daaffe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875537147470976:0@lo:700: 00000040:01000000:2.0:1788651712.451410:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:1.0:1788651712.451435:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009daaffe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7466:1875537147471104:0@lo:900: 00000100:00100000:1.0:1788651712.451467:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651712.451496:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147471104 00000100:00100000:1.0:1788651712.451500:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147471104 00000100:00100000:1.0:1788651712.451530:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651712.451537:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000218a8132 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7466:x1875537147471104:12345-0@lo:900: 00000100:00100000:1.0:1788651712.451571:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000218a8132 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7466:x1875537147471104:12345-0@lo:900: Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651712.451578:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651712.451595:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f272998f going to sleep for 11 seconds 00010000:00080000:1.0:1788651712.451610:0:7466:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000009daaffe x1875537147471104/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788651728 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000040:00080000:2.0:1788651712.451617:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788651712.451646:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009daaffe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7466:1875537147471104:0@lo:900: 00000100:00100000:1.0:1788651712.451722:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009daaffe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875537147471232:0@lo:1000: 00000100:00100000:1.0:1788651712.451749:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651712.451769:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147471232 00000100:00100000:1.0:1788651712.451773:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147471232 00000100:00100000:1.0:1788651712.451797:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788651712.451803:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082f7a327 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875537147471232:12345-0@lo:1000: 00000100:00100000:1.0:1788651712.451851:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082f7a327 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875537147471232:12345-0@lo:1000: Request processed in 48us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651712.451857:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788651712.451871:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 000000000450666c going to sleep for 11 seconds 00000100:00100000:1.0:1788651712.451883:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009daaffe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875537147471232:0@lo:1000: 00000004:00080000:1.0:1788651712.451953:0:7466:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000f272998f with version 0 00000020:00100000:1.0:1788651712.451969:0:7466:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1788651712.451974:0:7466:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000009daaffe x1875537147471488/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788651712.451987:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000009daaffe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875537147471488:0@lo:1000: 00000100:00100000:1.0:1788651712.452010:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651712.452028:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147471488 00000100:00100000:1.0:1788651712.452032:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147471488 00000100:00100000:1.0:1788651712.452049:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788651712.452054:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000291e66b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875537147471488:12345-0@lo:1000: 00000004:00000080:2.0:1788651712.452183:0:7439:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788651712.452192:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000100:00100000:1.0:1788651712.452345:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e0650c30 going to sleep for 11 seconds 00000040:00080000:2.0:1788651712.452405:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651712.454791:0:7439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788651712.455972:0:7439:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788651712.456027:0:7439:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1788651712.456438:0:7439:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788651712.457214:0:7439:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788651712.458176:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788651712.458328:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788651712.458522:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788651712.458737:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788651712.458871:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788651712.459207:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788651712.459337:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788651712.460810:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00000001:00080000:0.0:1788651712.461188:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1788651712.461378:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000291e66b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7466:x1875537147471488:12345-0@lo:1000: Request processed in 9319us (9362us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788651712.461402:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:2.0:1788651712.461433:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00000004:00080000:0.0:1788651712.461512:0:7466:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788651712.461518:0:7466:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788651712.461534:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000009daaffe pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875537147471488:0@lo:1000: 00000100:00100000:0.0:1788651712.461758:0:7466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094052050 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875537147471616:0@lo:1000: 00000100:00100000:0.0:1788651712.461839:0:7466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651712.461882:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147471616 00000100:00100000:1.0:1788651712.461890:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147471616 00000100:00100000:0.0:1788651712.461897:0:7466:0:(client.c:2716:ptlrpc_set_wait()) set 00000000113fe827 going to sleep for 11 seconds 00000100:00100000:1.0:1788651712.461961:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788651712.461970:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000012e79388 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1875537147471616:12345-0@lo:1000: 00000100:00100000:1.0:1788651712.462037:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000012e79388 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7466:x1875537147471616:12345-0@lo:1000: Request processed in 68us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651712.462047:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00100000:10000000:2.0:1788651712.462402:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00000100:00100000:0.0:1788651712.462557:0:7466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094052050 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7466:1875537147471616:0@lo:1000: 00000040:00080000:0.0:1788651712.462668:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788651712.462700:0:7466:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000712232c2 with version 1 00000004:00080000:2.0:1788651712.463033:0:7456:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000fc26b9fe version 1 rpc_version 1 00000020:00100000:2.0:1788651712.463057:0:7456:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788651712.463065:0:7456:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000004d1ac491 x1875537147471872/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788651712.463150:0:7456:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d1ac491 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1875537147471872:0@lo:1000: 00000100:00100000:2.0:1788651712.463197:0:7456:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651712.463229:0:7456:0:(client.c:2716:ptlrpc_set_wait()) set 00000000018e74e7 going to sleep for 11 seconds 00100000:10000000:2.0:1788651712.463389:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00000100:00100000:3.0:1788651712.463509:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085b50719 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7465:x1875537147470720:12345-0@lo:700: Request processed in 19048us (19294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651712.463524:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788651712.463526:0:7465:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000772ef606 x1875537147470720/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788651728 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651712.463540:0:7465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000772ef606 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7465:1875537147470720:0@lo:700: 40000000:02000000:2.0:1788651712.463551:0:7465:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:1.0:1788651712.463769:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147471872 00000100:00100000:1.0:1788651712.463776:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147471872 00000100:00100000:1.0:1788651712.463851:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788651712.463859:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003248707d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1875537147471872:12345-0@lo:1000: 00100000:10000000:3.0:1788651712.465905:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788651712.466222:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788651712.466365:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788651712.466549:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788651712.466840:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788651712.467178:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788651712.467311:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788651712.471281:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788651712.471546:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788651712.475425:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00000040:00080000:0.0:1788651712.477867:0:7466:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788651712.477986:0:7466:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000001:00080000:1.0:1788651712.484730:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00100000:10000000:3.0:1788651712.485484:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788651712.485904:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788651712.486070:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788651712.486226:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788651712.486360:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788651712.486497:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788651712.486663:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788651712.486814:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788651712.486975:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788651712.487111:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788651712.487247:0:7439:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788651712.487421:0:7439:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788651712.488116:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003248707d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7456:x1875537147471872:12345-0@lo:1000: Request processed in 24254us (24916us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788651712.488129:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1788651712.490337:0:7456:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788651712.490346:0:7456:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788651712.490366:0:7456:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d1ac491 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7456:1875537147471872:0@lo:1000: 00000001:00080000:3.0:1788651712.494780:0:7439:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788651712.494822:0:7439:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa71c0557b988 00100000:10000000:3.0:1788651712.494830:0:7439:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:0.0:1788651712.495730:0:7439:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788651712.495759:0:7439:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788651712.495782:0:7439:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788651712.495812:0:7439:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:0.0:1788651712.499353:0:7439:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788651712.500803:0:7439:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:3.0:1788651712.552977:0:7465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788651712.564459:0:7465:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788651712.564534:0:7465:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788651712.564539:0:7465:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:1.0:1788651712.993702:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651714.017476:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651715.042197:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651716.065993:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651717.088144:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651717.600324:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a8039fb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147472000:0@lo:41: 00000100:00100000:3.0:1788651717.600427:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651717.600515:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147472000 00000100:00100000:3.0:1788651717.600523:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147472000 00000100:00100000:3.0:1788651717.600583:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788651717.600592:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c9649b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147472000:12345-0@lo:41: 00000004:00000024:3.0:1788651717.600638:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1788651717.600692:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c9649b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147472000:12345-0@lo:41: Request processed in 101us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651717.600699:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788651717.600760:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a8039fb7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147472000:0@lo:41: 00000100:00100000:2.0:1788651717.609173:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094052050 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147472128:0@lo:400: 00000100:00100000:3.0:1788651717.609211:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006422fe01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147472256:0@lo:400: 00000100:00100000:0.0:1788651717.609292:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ac98426 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147472384:0@lo:400: 00000100:00100000:2.0:1788651717.614135:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651717.617152:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651717.617323:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147472256 00000100:00100000:1.0:1788651717.617334:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147472256 00000100:00100000:1.0:1788651717.617383:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788651717.617391:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8039fb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147472256:12345-0@lo:400: 00000100:00100000:1.0:1788651717.617470:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8039fb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147472256:12345-0@lo:400: Request processed in 79us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651717.617477:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788651717.617519:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000006422fe01 x1875537147472256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651717.617545:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006422fe01 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147472256:0@lo:400: 00000100:00100000:0.0:1788651717.617689:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147472128 00000100:00100000:0.0:1788651717.617694:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147472128 00000100:00100000:0.0:1788651717.617735:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788651717.617875:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee249fd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:3637:x1875537147472128:12345-0@lo:400: 00000100:00100000:0.0:1788651717.617941:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee249fd9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:3637:x1875537147472128:12345-0@lo:400: Request processed in 200us (3813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651717.618020:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788651717.618074:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651717.618347:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094052050 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147472128:0@lo:400: 00000100:00100000:2.0:1788651717.618819:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147472384 00000100:00100000:2.0:1788651717.618826:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147472384 00000100:00100000:2.0:1788651717.618864:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788651717.618869:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093659b4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147472384:12345-0@lo:400: 00000100:00100000:2.0:1788651717.618944:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093659b4b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147472384:12345-0@lo:400: Request processed in 74us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651717.618951:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788651717.619064:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000005ac98426 x1875537147472384/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651733 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651717.619076:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ac98426 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147472384:0@lo:400: 00000001:02000400:3.0:1788651717.988653:0:7710:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788651718.114668:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651719.144529:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788651719.167605:0:7763:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788651719.175699:0:7763:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788651720.161174:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651721.184337:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788651721.184477:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788651721.184482:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86f48d9800 from 4 10000000:01000000:2.0:1788651721.184486:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788651721.184531:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 000000003cbd7a90/0xcd2f56ea038c38e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651721.184544:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 000000003cbd7a90/0xcd2f56ea038c38e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651721.184553:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 000000003cbd7a90/0xcd2f56ea038c38e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651721.184580:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000772ef606 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147472512:0@lo:101: 00000100:00100000:2.0:1788651721.184650:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651721.184706:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f7e659f8 going to sleep for 11 seconds 00000100:00100000:0.0:1788651721.184902:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147472512 00000100:00100000:0.0:1788651721.184940:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147472512 00000100:00100000:0.0:1788651721.184992:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788651721.185000:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000050254125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:6507:x1875537147472512:12345-0@lo:101: 00010000:00010000:0.0:1788651721.185013:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651721.185025:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a751466/0xcd2f56ea038c38ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c38e3 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651721.185048:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a751466/0xcd2f56ea038c38ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c38e3 expref: 14 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651721.185058:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a751466/0xcd2f56ea038c38ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c38e3 expref: 14 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651721.185067:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a751466, rc 0) 00000100:00100000:0.0:1788651721.185151:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000050254125 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:6507:x1875537147472512:12345-0@lo:101: Request processed in 152us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651721.185158:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788651721.185459:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000772ef606 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147472512:0@lo:101: 00010000:00010000:2.0:1788651721.185485:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 000000003cbd7a90/0xcd2f56ea038c38e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651721.185504:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 000000003cbd7a90/0xcd2f56ea038c38e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651721.185554:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000772ef606 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147472640:0@lo:256: 00000100:00100000:2.0:1788651721.185692:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651721.185727:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f7e659f8 going to sleep for 11 seconds 00000100:00100000:1.0:1788651721.186005:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147472640 00000100:00100000:1.0:1788651721.186010:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147472640 00000100:00100000:1.0:1788651721.186052:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788651721.186059:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067910f66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:6507:x1875537147472640:12345-0@lo:256: 20000000:01000000:1.0:1788651721.186078:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788651721.186095:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788651721.186098:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788651721.186202:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067910f66 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:6507:x1875537147472640:12345-0@lo:256: Request processed in 143us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651721.186209:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788651721.186399:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000772ef606 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147472640:0@lo:256: 10000000:01000000:3.0:1788651721.186461:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788651721.186478:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 000000003cbd7a90/0xcd2f56ea038c38e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651721.186487:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 000000003cbd7a90/0xcd2f56ea038c38e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651721.186497:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788651721.186499:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86da667000 from 21 10000000:01000000:3.0:1788651721.186502:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788651721.186523:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c38f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651721.186528:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c38f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651721.186535:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c38f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651721.186547:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147472768:0@lo:101: 00000100:00100000:3.0:1788651721.186578:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.186608:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bdd2bad0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651721.186726:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147472768 00000100:00100000:2.0:1788651721.186731:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147472768 00000100:00100000:2.0:1788651721.186753:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788651721.186759:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b9bb532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:6507:x1875537147472768:12345-0@lo:101: 00010000:00010000:2.0:1788651721.186767:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651721.186777:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c38f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c38f1 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651721.186802:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c38f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c38f1 expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651721.186810:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000920b3a73/0xcd2f56ea038c38f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c38f1 expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651721.186817:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000920b3a73, rc 0) 00000100:00100000:2.0:1788651721.186862:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b9bb532 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147472768:12345-0@lo:101: Request processed in 103us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651721.186868:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788651721.187129:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147472768:0@lo:101: 00010000:00010000:3.0:1788651721.187141:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c38f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651721.187148:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c38f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651721.187235:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147472896:0@lo:501: 00000100:00100000:3.0:1788651721.187264:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.187414:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bdd2bad0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651721.187777:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147472896 00000100:00100000:0.0:1788651721.187784:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147472896 00000100:00100000:0.0:1788651721.187840:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788651721.187846:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2bc7f2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147472896:12345-0@lo:501: 00000100:00100000:0.0:1788651721.188268:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2bc7f2f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147472896:12345-0@lo:501: Request processed in 422us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651721.188402:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788651721.188575:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147472896:0@lo:501: 00000100:00100000:3.0:1788651721.188615:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473024:0@lo:503: 00000100:00100000:3.0:1788651721.188667:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.188700:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bdd2bad0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651721.188756:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147473024 00000100:00100000:1.0:1788651721.188762:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147473024 00000100:00100000:1.0:1788651721.188800:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788651721.188807:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a71a176e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147473024:12345-0@lo:503: 00000100:00100000:1.0:1788651721.188934:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a71a176e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147473024:12345-0@lo:503: Request processed in 128us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651721.188941:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788651721.189182:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473024:0@lo:503: 00000100:00100000:2.0:1788651721.190056:0:7815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009747f219 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7815:1875537147473152:0@lo:502: 00000100:00100000:2.0:1788651721.190111:0:7815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651721.190146:0:7815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a28375a0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651721.190371:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147473152 00000100:00100000:0.0:1788651721.190378:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147473152 00000100:00100000:0.0:1788651721.190419:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788651721.190427:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5d2f3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7815:x1875537147473152:12345-0@lo:502: 00000100:00100000:0.0:1788651721.190707:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5d2f3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7815:x1875537147473152:12345-0@lo:502: Request processed in 281us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651721.190720:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788651721.190815:0:7815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009747f219 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7815:1875537147473152:0@lo:502: 00000100:00100000:2.0:1788651721.191392:0:7815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009747f219 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7815:1875537147473280:0@lo:502: 00000100:00100000:2.0:1788651721.191442:0:7815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651721.191555:0:7815:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a28375a0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651721.191665:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147473280 00000100:00100000:1.0:1788651721.191673:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147473280 00000100:00100000:1.0:1788651721.191718:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788651721.191726:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad9bd87f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7815:x1875537147473280:12345-0@lo:502: 00000100:00100000:1.0:1788651721.191836:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad9bd87f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:7815:x1875537147473280:12345-0@lo:502: Request processed in 111us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651721.191844:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788651721.192152:0:7815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009747f219 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7815:1875537147473280:0@lo:502: 00000040:00080000:2.0:1788651721.192179:0:7815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788651721.192854:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788651721.192886:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788651721.192896:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c38f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651721.192934:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 00000000610d8455/0xcd2f56ea038c38f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651721.192944:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788651721.192946:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86da667000 from 4 10000000:01000000:0.0:1788651721.192949:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788651721.192983:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c38ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651721.192991:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c38ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651721.193000:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c38ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651721.193018:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005ac98426 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473408:0@lo:101: 00000100:00100000:0.0:1788651721.193062:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651721.193641:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 000000006661d538 going to sleep for 11 seconds 00000100:00100000:1.0:1788651721.193725:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147473408 00000100:00100000:1.0:1788651721.193733:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147473408 00000100:00100000:1.0:1788651721.193777:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788651721.193793:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a14de533 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147473408:12345-0@lo:101: 00010000:00010000:1.0:1788651721.193805:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651721.193817:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c3906 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c38ff expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651721.193848:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c3906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c38ff expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651721.193858:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f2fda1c9/0xcd2f56ea038c3906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c38ff expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651721.193866:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f2fda1c9, rc 0) 00000100:00100000:1.0:1788651721.194102:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a14de533 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147473408:12345-0@lo:101: Request processed in 317us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651721.194109:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788651721.194527:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005ac98426 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473408:0@lo:101: 00010000:00010000:3.0:1788651721.194544:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c38ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651721.194554:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c38ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651721.194617:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473536:0@lo:256: 00000100:00100000:3.0:1788651721.194656:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.194689:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bdd2bad0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651721.194748:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147473536 00000100:00100000:0.0:1788651721.194754:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147473536 00000100:00100000:0.0:1788651721.195045:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788651721.195053:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008475532c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147473536:12345-0@lo:256: 20000000:01000000:0.0:1788651721.195070:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788651721.195090:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788651721.195092:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788651721.195174:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008475532c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147473536:12345-0@lo:256: Request processed in 123us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651721.195182:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788651721.196814:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473536:0@lo:256: 10000000:01000000:3.0:1788651721.197401:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788651721.197410:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c38ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651721.197419:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 00000000c0cae402/0xcd2f56ea038c38ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651721.197437:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788651721.197439:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788651721.197442:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788651721.198078:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c390d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651721.198090:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c390d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651721.198099:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c390d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651721.198121:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473664:0@lo:101: 00000100:00100000:3.0:1788651721.198182:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.198232:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bdd2bad0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651721.198549:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147473664 00000100:00100000:0.0:1788651721.198558:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147473664 00000100:00100000:0.0:1788651721.198612:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788651721.198621:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8595514 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147473664:12345-0@lo:101: 00010000:00010000:0.0:1788651721.198636:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651721.198648:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004cdcf3d6/0xcd2f56ea038c3914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c390d expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651721.198672:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004cdcf3d6/0xcd2f56ea038c3914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c390d expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651721.198682:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004cdcf3d6/0xcd2f56ea038c3914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c390d expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651721.198691:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004cdcf3d6, rc 0) 00000100:00100000:0.0:1788651721.198746:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8595514 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147473664:12345-0@lo:101: Request processed in 126us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651721.198753:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788651721.201076:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473664:0@lo:101: 00010000:00010000:1.0:1788651721.201102:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c390d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651721.201112:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c390d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651721.201201:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039c8c080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473792:0@lo:501: 00000100:00100000:1.0:1788651721.201255:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651721.202434:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e0a6708 going to sleep for 11 seconds 00000100:00100000:2.0:1788651721.202589:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147473792 00000100:00100000:2.0:1788651721.202599:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147473792 00000100:00100000:2.0:1788651721.202660:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788651721.202668:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba07d87d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147473792:12345-0@lo:501: 00000100:00100000:2.0:1788651721.202806:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba07d87d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147473792:12345-0@lo:501: Request processed in 139us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651721.202813:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788651721.203417:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039c8c080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473792:0@lo:501: 00000100:00100000:1.0:1788651721.203855:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039c8c080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473920:0@lo:503: 00000100:00100000:1.0:1788651721.205413:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.205643:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147473920 00000100:00100000:3.0:1788651721.205653:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147473920 00000100:00100000:3.0:1788651721.205706:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788651721.205714:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edb8d0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147473920:12345-0@lo:503: 00000100:00100000:3.0:1788651721.205850:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edb8d0b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147473920:12345-0@lo:503: Request processed in 136us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651721.205858:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788651721.205983:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e0a6708 going to sleep for 11 seconds 00000100:00100000:1.0:1788651721.206005:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039c8c080 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147473920:0@lo:503: 00000100:00100000:0.0:1788651721.221721:0:7816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000094052050 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7816:1875537147474048:0@lo:502: 00000100:00100000:0.0:1788651721.221832:0:7816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.225276:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147474048 00000100:00100000:3.0:1788651721.225293:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147474048 00000100:00100000:3.0:1788651721.225370:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788651721.225380:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d60f38b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:7816:x1875537147474048:12345-0@lo:502: 00000100:00100000:3.0:1788651721.225573:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d60f38b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:7816:x1875537147474048:12345-0@lo:502: Request processed in 194us (3742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651721.225588:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788651721.226136:0:7816:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dad18cc6 going to sleep for 11 seconds 00000100:00100000:1.0:1788651721.226164:0:7816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000094052050 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7816:1875537147474048:0@lo:502: 00000020:01000000:1.0:1788651721.226210:0:7816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651721.226222:0:7816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651721.226225:0:7816:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788651721.226230:0:7816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788651721.226233:0:7816:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:00000080:1.0:1788651721.226257:0:7816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788651721.226272:0:7816:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (000000002c6bb17c) 00000020:00000080:1.0:1788651721.226291:0:7816:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:1.0:1788651721.226297:0:7816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788651721.226382:0:7816:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788651721.226388:0:7816:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788651721.226394:0:7816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c3922 00010000:00080000:1.0:1788651721.226424:0:7816:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b6ce40b2@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:1.0:1788651721.233288:0:7816:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1788651721.240865:0:7816:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788651721.240882:0:7816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788651721.240941:0:7816:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788651721.240963:0:7816:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c3929 00000100:00080000:1.0:1788651721.241131:0:7816:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788651721.241139:0:7816:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000b6ce40b2 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788651721.241175:0:7816:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000039c8c080 x1875537147474176/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788651721.241251:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039c8c080 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147474176:0@lo:38: 00000100:00100000:0.0:1788651721.241332:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.241505:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147474176 00000100:00080000:1.0:1788651721.241511:0:7816:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788651721.241513:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147474176 00000100:00100000:3.0:1788651721.241546:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788651721.241552:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cdc3f379 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147474176:12345-0@lo:38: 00000040:01000000:1.0:1788651721.241555:0:7816:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00010000:00080000:3.0:1788651721.241576:0:6514:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1788651721.241607:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c3930 00000004:00100000:3.0:1788651721.241622:0:6514:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788651721.241627:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:2.0:1788651721.241806:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000557d0bbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147474432:0@lo:400: 00000100:00100000:2.0:1788651721.241848:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651721.241884:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651721.241890:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000a9a430c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147474560:0@lo:400: 00000100:00100000:2.0:1788651721.241938:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651721.241978:0:6515:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788651721.241987:0:6515:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788651721.246047:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147474560 00000100:00100000:2.0:1788651721.246065:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147474560 00000100:00100000:2.0:1788651721.246149:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788651721.246158:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000772ef606 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147474560:12345-0@lo:400: 00000100:00100000:2.0:1788651721.246262:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000772ef606 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147474560:12345-0@lo:400: Request processed in 106us (4323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651721.246269:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788651721.246335:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000a9a430c x1875537147474560/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651721.246350:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000a9a430c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147474560:0@lo:400: 00000100:00100000:2.0:1788651721.250324:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651721.250352:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009747f219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147474304:0@lo:400: 00000100:00100000:2.0:1788651721.250428:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.250558:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147474304 00000100:00100000:3.0:1788651721.250568:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147474304 00000100:00100000:3.0:1788651721.250624:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788651721.250634:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a9a430c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147474304:12345-0@lo:400: 00000100:00100000:3.0:1788651721.250695:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a9a430c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147474304:12345-0@lo:400: Request processed in 63us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651721.250702:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788651721.250739:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000009747f219 x1875537147474304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651721.250751:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009747f219 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147474304:0@lo:400: 00000100:00100000:2.0:1788651721.254204:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147474432 00000100:00100000:2.0:1788651721.254217:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147474432 00000100:00080000:3.0:1788651721.254438:0:7819:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@00000000f22f87fa x1875537147474688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651721.254451:0:7819:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c007c2f going to sleep for 0 seconds 00000020:01000000:2.0:1788651721.254660:0:7816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651721.254667:0:7816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651721.254669:0:7816:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788651721.254672:0:7816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651721.254676:0:7816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651721.254677:0:7816:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788651721.254679:0:7816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788651721.254681:0:7816:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788651721.254705:0:7816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d1ac491 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7816:1875537147474816:0@lo:502: 00000100:00100000:2.0:1788651721.254794:0:7816:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651721.254834:0:7816:0:(client.c:2716:ptlrpc_set_wait()) set 000000005204c975 going to sleep for 11 seconds 00000100:00100000:3.0:1788651721.254885:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147474816 00000100:00100000:3.0:1788651721.254891:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147474816 00000100:00100000:3.0:1788651721.254953:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788651721.254962:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000258b9cef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:7816:x1875537147474816:12345-0@lo:502: 00000100:00100000:3.0:1788651721.255086:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000258b9cef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:7816:x1875537147474816:12345-0@lo:502: Request processed in 125us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651721.255093:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788651721.255632:0:7816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d1ac491 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:7816:1875537147474816:0@lo:502: 00000020:01000000:2.0:1788651721.255661:0:7816:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651721.255667:0:7816:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651721.255669:0:7816:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788651721.255672:0:7816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1788651721.255881:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788651721.255904:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00000100:00100000:1.0:1788651721.255927:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788651721.255929:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c390d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651721.255936:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f1e80cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147474432:12345-0@lo:400: 00010000:00010000:3.0:1788651721.255942:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 000000006ed1ab35/0xcd2f56ea038c390d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651721.255951:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788651721.255954:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f86da6c3380 from 1 10000000:01000000:3.0:1788651721.255957:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788651721.255983:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 0000000046ea56b3/0xcd2f56ea038c3937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651721.255991:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 0000000046ea56b3/0xcd2f56ea038c3937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651721.255991:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f1e80cf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147474432:12345-0@lo:400: Request processed in 57us (14143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651721.255998:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:3.0:1788651721.256000:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 0000000046ea56b3/0xcd2f56ea038c3937 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651721.256014:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147474944:0@lo:101: 00000100:00100000:1.0:1788651721.256029:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000557d0bbc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147474432:0@lo:400: 00000100:00100000:3.0:1788651721.256045:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.256070:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a359216f going to sleep for 11 seconds 00000100:00100000:1.0:1788651721.256075:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147474944 00000100:00100000:1.0:1788651721.256079:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147474944 00000100:00100000:1.0:1788651721.256108:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788651721.256114:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4983b1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147474944:12345-0@lo:101: 00010000:00010000:1.0:1788651721.256122:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651721.256133:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f37f858/0xcd2f56ea038c393e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3937 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651721.256153:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f37f858/0xcd2f56ea038c393e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3937 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651721.256162:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f37f858/0xcd2f56ea038c393e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3937 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651721.256170:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f37f858, rc 0) 00000100:00100000:1.0:1788651721.256203:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4983b1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147474944:12345-0@lo:101: Request processed in 89us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651721.256209:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788651721.256272:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000823524c8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147474944:0@lo:101: 00010000:00010000:2.0:1788651721.256284:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 0000000046ea56b3/0xcd2f56ea038c3937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651721.256292:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 0000000046ea56b3/0xcd2f56ea038c3937 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651721.256347:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004d1ac491 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147475072:0@lo:501: 00000100:00100000:2.0:1788651721.256373:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651721.256392:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000199078ab going to sleep for 11 seconds 00000100:00100000:2.0:1788651721.256403:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147475072 00000100:00100000:2.0:1788651721.256406:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147475072 00000100:00100000:2.0:1788651721.256435:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788651721.256440:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce18c8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147475072:12345-0@lo:501: 00000100:00100000:2.0:1788651721.256522:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce18c8f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147475072:12345-0@lo:501: Request processed in 82us (148us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788651721.256529:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788651721.259081:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004d1ac491 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147475072:0@lo:501: 10000000:01000000:0.0:1788651721.259144:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788651721.259153:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: 0000000046ea56b3/0xcd2f56ea038c3937 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651721.259163:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: 0000000046ea56b3/0xcd2f56ea038c3937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788651721.261542:0:6514:0:(import.c:65:import_set_state_nolock()) 000000007db93cdb : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788651721.261719:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cdc3f379 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3634:x1875537147474176:12345-0@lo:38: Request processed in 20164us (20386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651721.261739:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788651721.265068:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788651721.265108:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788651721.265117:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788651721.265124:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788651721.265127:0:3634:0:(import.c:65:import_set_state_nolock()) 00000000b6ce40b2 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788651721.265147:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000000c007c2f): req@00000000f22f87fa x1875537147474688/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651721.265164:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039c8c080 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147474176:0@lo:38: 00000100:00100000:3.0:1788651721.265330:0:7819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651721.265373:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147474688 00000100:00100000:3.0:1788651721.265378:0:7819:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c007c2f going to sleep for 11 seconds 00000100:00100000:2.0:1788651721.265381:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147474688 00000100:00100000:2.0:1788651721.265429:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788651721.265437:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e81e8d3f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7819:x1875537147474688:12345-0@lo:1000: 00000100:00100000:2.0:1788651721.265521:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e81e8d3f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7819:x1875537147474688:12345-0@lo:1000: Request processed in 85us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651721.265529:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788651721.265605:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000221bfc20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147475200:0@lo:41: 00000100:00100000:0.0:1788651721.265637:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.265749:0:7819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f22f87fa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7819:1875537147474688:0@lo:1000: 00000040:01000000:3.0:1788651721.265791:0:7819:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788651721.265824:0:7819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f22f87fa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7819:1875537147475328:0@lo:1000: 00000100:00100000:3.0:1788651721.265851:0:7819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.265873:0:7819:0:(client.c:2716:ptlrpc_set_wait()) set 000000000c007c2f going to sleep for 11 seconds 00000100:00100000:3.0:1788651721.265887:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147475200 00000100:00100000:3.0:1788651721.265891:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147475200 00000100:00100000:3.0:1788651721.265933:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147475328 00000100:00100000:3.0:1788651721.265936:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147475328 00000100:00100000:3.0:1788651721.265950:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788651721.265955:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000efa73e33 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1875537147475200:12345-0@lo:41: 00000004:00000024:3.0:1788651721.265977:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1788651721.266023:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000efa73e33 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1875537147475200:12345-0@lo:41: Request processed in 68us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651721.266030:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788651721.266044:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788651721.266050:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035356488 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7819:x1875537147475328:12345-0@lo:1000: 00000100:00100000:3.0:1788651721.266156:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035356488 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7819:x1875537147475328:12345-0@lo:1000: Request processed in 106us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651721.266162:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788651721.266184:0:7819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f22f87fa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7819:1875537147475328:0@lo:1000: 00000100:00100000:3.0:1788651721.266220:0:7819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f22f87fa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7819:1875537147475456:0@lo:700: 00000100:00100000:3.0:1788651721.266243:0:7819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651721.266267:0:7819:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc95f3ac going to sleep for 11 seconds 00000100:00100000:1.0:1788651721.266581:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147475456 00000100:00100000:1.0:1788651721.266587:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147475456 00000100:00100000:1.0:1788651721.266618:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788651721.266624:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024ebb513 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7819:x1875537147475456:12345-0@lo:700: 00000100:00100000:1.0:1788651721.266669:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024ebb513 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:lustre-MDT0000-mdtlov_UUID+6:7819:x1875537147475456:12345-0@lo:700: Request processed in 46us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651721.266675:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788651721.266705:0:7819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f22f87fa pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7819:1875537147475456:0@lo:700: 00000100:00100000:1.0:1788651721.266815:0:7819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000039c8c080 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7819:1875537147475584:0@lo:1000: 00000100:00100000:1.0:1788651721.266841:0:7819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651721.266855:0:7819:0:(client.c:2716:ptlrpc_set_wait()) set 000000001f2ae029 going to sleep for 11 seconds 00000100:00100000:0.0:1788651721.267065:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000221bfc20 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147475200:0@lo:41: 00000100:00100000:3.0:1788651721.267159:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147475584 00000100:00100000:3.0:1788651721.267165:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147475584 00000100:00100000:3.0:1788651721.267197:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788651721.267203:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009daaffe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7819:x1875537147475584:12345-0@lo:1000: 00000100:00100000:3.0:1788651721.267255:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009daaffe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7819:x1875537147475584:12345-0@lo:1000: Request processed in 52us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651721.267261:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788651721.267374:0:7819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000039c8c080 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7819:1875537147475584:0@lo:1000: 00000004:00080000:0.0:1788651721.267425:0:7819:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000005fd5512e with version 0 00000020:00100000:0.0:1788651721.267439:0:7819:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788651721.267455:0:7819:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000074927a57 x1875537147475840/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788651721.267477:0:7819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074927a57 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7819:1875537147475840:0@lo:1000: 00000100:00100000:0.0:1788651721.267503:0:7819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651721.267513:0:7819:0:(client.c:2716:ptlrpc_set_wait()) set 000000001186b5d1 going to sleep for 11 seconds 00000100:00100000:3.0:1788651721.267657:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147475840 00000100:00100000:3.0:1788651721.267661:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147475840 00000100:00100000:3.0:1788651721.267680:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788651721.267687:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000094052050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:7819:x1875537147475840:12345-0@lo:1000: 00000001:00080000:0.0:1788651721.281088:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:0.0:1788651721.281103:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788651721.281348:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000094052050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7819:x1875537147475840:12345-0@lo:1000: Request processed in 13657us (13839us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788651721.281365:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1788651721.281646:0:7819:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1788651721.281651:0:7819:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788651721.281666:0:7819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074927a57 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7819:1875537147475840:0@lo:1000: 00000100:00100000:0.0:1788651721.281760:0:7819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074927a57 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7819:1875537147475968:0@lo:1000: 00000100:00100000:0.0:1788651721.281814:0:7819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651721.281850:0:7819:0:(client.c:2716:ptlrpc_set_wait()) set 00000000925cc9ac going to sleep for 11 seconds 00000100:00100000:2.0:1788651721.281933:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147475968 00000100:00100000:2.0:1788651721.281940:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147475968 00000100:00100000:2.0:1788651721.281989:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788651721.281998:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ac98426 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7819:x1875537147475968:12345-0@lo:1000: 00000100:00100000:2.0:1788651721.282088:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ac98426 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7819:x1875537147475968:12345-0@lo:1000: Request processed in 91us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651721.282095:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788651721.282281:0:7819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074927a57 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7819:1875537147475968:0@lo:1000: 00000040:00080000:0.0:1788651721.282301:0:7819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788651721.282337:0:7819:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000001186b5d1 with version 1 00000004:00080000:2.0:1788651721.282597:0:7817:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000bd78cd20 version 1 rpc_version 1 00000020:00100000:2.0:1788651721.282616:0:7817:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788651721.282630:0:7817:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000015553787 x1875537147476224/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788651721.282644:0:7817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015553787 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7817:1875537147476224:0@lo:1000: 00000100:00100000:2.0:1788651721.282679:0:7817:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651721.282705:0:7817:0:(client.c:2716:ptlrpc_set_wait()) set 000000001b9518cb going to sleep for 11 seconds 00000100:00100000:3.0:1788651721.283368:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147476224 00000100:00100000:3.0:1788651721.283376:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147476224 00000100:00100000:3.0:1788651721.283473:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788651721.283481:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea8149c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7817:x1875537147476224:12345-0@lo:1000: 00000040:00080000:0.0:1788651721.287718:0:7819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788651721.287817:0:7819:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788651721.287822:0:7819:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:1.0:1788651721.289094:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1788651721.289323:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea8149c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:7817:x1875537147476224:12345-0@lo:1000: Request processed in 5839us (6639us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788651721.289336:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1788651721.289431:0:7817:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1788651721.289435:0:7817:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788651721.289473:0:7817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015553787 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7817:1875537147476224:0@lo:1000: 00010000:00010000:1.0:1788651722.214195:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788651722.321228:0:7870:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788651722.321567:0:7870:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788651722.720283:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000717c9ce7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147476352:0@lo:41: 00000100:00100000:1.0:1788651722.720356:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651722.720544:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147476352 00000100:00100000:2.0:1788651722.720553:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147476352 00000100:00100000:2.0:1788651722.720603:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788651722.720611:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000258791d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147476352:12345-0@lo:41: 00000004:00000024:2.0:1788651722.720646:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788651722.720709:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000258791d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147476352:12345-0@lo:41: Request processed in 99us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651722.720717:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788651722.720861:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000717c9ce7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147476352:0@lo:41: 00010000:00010000:3.0:1788651723.237249:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788651723.582158:0:7918:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeb4a56ae0 20000000:00000080:3.0:1788651723.582177:0:7918:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f86ee8cd800 uarg=0000000000000000 20000000:01000000:3.0:1788651723.582216:0:7918:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788651723.582224:0:7918:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788651723.582228:0:7918:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788651723.582379:0:7918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788651723.582390:0:7918:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788651723.586938:0:7918:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788651723.587198:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788651723.587231:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788651723.587608:0:7918:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788651723.587626:0:7918:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788651723.587644:0:7918:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.587662:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f09f8b0d/0xcd2f56ea038c37c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c37bd expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.587670:0:7918:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003126b5e5/0xcd2f56ea038c38b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c38ab expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.587677:0:7918:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.587715:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003126b5e5/0xcd2f56ea038c38b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c38ab expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.587728:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003126b5e5/0xcd2f56ea038c38b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c38ab expref: 17 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651723.587741:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000052c3961a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875537147476480:0@lo:104: 00000100:00100000:3.0:1788651723.587807:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651723.588080:0:7918:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f09f8b0d/0xcd2f56ea038c37c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c37bd expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.588088:0:7918:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f09f8b0d/0xcd2f56ea038c37c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c37bd expref: 17 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651723.588112:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f2edfae pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875537147476608:0@lo:104: 00000100:00100000:3.0:1788651723.588135:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set 000000002afb2572 going to sleep for 11 seconds 00000100:00100000:2.0:1788651723.588472:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788651723.588496:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651723.588524:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147476480 00000100:00100000:2.0:1788651723.588530:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147476480 00000100:00100000:2.0:1788651723.588567:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147476608 00000100:00100000:2.0:1788651723.588570:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147476608 00000100:00100000:2.0:1788651723.588584:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788651723.588591:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9576ffd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:7918:x1875537147476480:12345-0@lo:104: 00010000:00010000:2.0:1788651723.588603:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651723.588666:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788651723.588671:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9576ffd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:7918:x1875537147476480:12345-0@lo:104: Request processed in 81us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651723.588678:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788651723.588721:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788651723.588727:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007df1a1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:7918:x1875537147476608:12345-0@lo:104: 00010000:00010000:2.0:1788651723.588746:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651723.588782:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788651723.588787:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007df1a1a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:7918:x1875537147476608:12345-0@lo:104: Request processed in 61us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651723.588793:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1788651723.588808:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788651723.588812:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651723.588819:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f617ab95 already unused, calling callback (00000000db8c17d1) 10000000:00010000:2.0:1788651723.588822:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651723.588830:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651723.588836:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651723.588841:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788651723.588847:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651723.588856:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651723.588862:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fe1d941c already unused, calling callback (00000000db8c17d1) 10000000:00010000:1.0:1788651723.588864:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651723.588866:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651723.588869:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651723.588872:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1788651723.588875:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651723.588879:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788651723.588891:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651723.588897:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788651723.589119:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000052c3961a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875537147476480:0@lo:104: 00000100:00100000:0.0:1788651723.589129:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f2edfae pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7918:1875537147476608:0@lo:104: 00010000:00010000:0.0:1788651723.589151:0:7918:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651723.589988:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053848ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147476736:0@lo:103: 00010000:00010000:2.0:1788651723.590040:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651723.590041:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788651723.590062:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: 00000000f617ab95/0xcd2f56ea038c38ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38b2 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651723.590074:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651723.590076:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651723.590078:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651723.590081:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651723.590086:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000720d4fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147476864:0@lo:103: 00000100:00100000:3.0:1788651723.590106:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651723.590192:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147476736 00000100:00100000:2.0:1788651723.590199:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147476736 00010000:00010000:2.0:1788651723.590303:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003126b5e5/0xcd2f56ea038c38b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c38ab expref: 18 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651723.590333:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147476864 00000100:00100000:2.0:1788651723.590337:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147476864 00000100:00100000:3.0:1788651723.590348:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788651723.590349:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f09f8b0d/0xcd2f56ea038c37c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c37bd expref: 19 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651723.590356:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007803770b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:3637:x1875537147476736:12345-0@lo:103: 00000100:00100000:2.0:1788651723.590360:0:6496:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788651723.590366:0:6496:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788651723.590368:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651723.590372:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003126b5e5/0xcd2f56ea038c38b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c38ab expref: 19 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590384:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003126b5e5/0xcd2f56ea038c38b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c38ab expref: 19 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590399:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003126b5e5/0xcd2f56ea038c38b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c38ab expref: 19 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590412:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651723.590715:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007803770b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:3637:x1875537147476736:12345-0@lo:103: Request processed in 360us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651723.590723:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788651723.590739:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788651723.590745:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ca40151 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:3637:x1875537147476864:12345-0@lo:103: 00010000:00010000:3.0:1788651723.590753:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651723.590762:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f09f8b0d/0xcd2f56ea038c37c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c37bd expref: 17 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590770:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f09f8b0d/0xcd2f56ea038c37c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c37bd expref: 17 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590778:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f09f8b0d/0xcd2f56ea038c37c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c37bd expref: 17 pid: 6504 timeout: 329 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590790:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590797:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590809:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590816:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590822:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590828:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590833:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005e3c3f20 already unused, calling callback (00000000e30859f5) 00010000:00010000:3.0:1788651723.590837:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590844:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590863:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651723.590873:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651723.590896:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ca40151 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:3637:x1875537147476864:12345-0@lo:103: Request processed in 151us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651723.590902:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788651723.590987:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000720d4fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147476864:0@lo:103: 00000100:00100000:0.0:1788651723.590998:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053848ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147476736:0@lo:103: 00010000:00010000:0.0:1788651723.591024:0:7918:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651723.591032:0:7918:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651723.591037:0:7918:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000005e3c3f20/0xcd2f56ea038c3945 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7918 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651723.592213:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651723.592224:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: 00000000fe1d941c/0xcd2f56ea038c37bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c37c4 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651723.592321:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651723.592324:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651723.592326:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651724.256546:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651725.280092:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651726.304107:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000053848ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147477376:0@lo:400: 00000100:00100000:2.0:1788651726.304182:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651726.304240:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651726.304247:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e5173943 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147477248:0@lo:400: 00000100:00100000:2.0:1788651726.304273:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651726.304311:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147477376 00000100:00100000:2.0:1788651726.304319:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147477376 00000100:00100000:2.0:1788651726.304377:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788651726.304387:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000221bfc20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147477376:12345-0@lo:400: 00000100:00100000:2.0:1788651726.304438:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000221bfc20 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147477376:12345-0@lo:400: Request processed in 53us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651726.304454:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788651726.304500:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000053848ac0 x1875537147477376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651726.304515:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000053848ac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147477376:0@lo:400: 00000100:00100000:3.0:1788651726.304892:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147477248 00000100:00100000:3.0:1788651726.304898:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147477248 00000100:00100000:0.0:1788651726.304919:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a9a9a96f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147476992:0@lo:400: 00000100:00100000:3.0:1788651726.304940:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788651726.304946:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d1ac491 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147477248:12345-0@lo:400: 00000100:00100000:0.0:1788651726.304957:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651726.304984:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015553787 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147477504:0@lo:400: 00000100:00100000:3.0:1788651726.304985:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d1ac491 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147477248:12345-0@lo:400: Request processed in 40us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651726.304991:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788651726.305005:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651726.305023:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651726.305028:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ebbb0cd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147477120:0@lo:400: 00000100:00100000:0.0:1788651726.305050:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651726.305106:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147476992 00000100:00100000:0.0:1788651726.305110:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147476992 00000100:00100000:0.0:1788651726.305139:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788651726.305145:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057fc95b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:3635:x1875537147476992:12345-0@lo:400: 00000100:00100000:0.0:1788651726.305176:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057fc95b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:3635:x1875537147476992:12345-0@lo:400: Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651726.305183:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788651726.305209:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147477504 00000100:00100000:0.0:1788651726.305213:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147477504 00000100:00100000:0.0:1788651726.305232:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788651726.305237:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000074927a57 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147477504:12345-0@lo:400: 00000100:00100000:0.0:1788651726.305267:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000074927a57 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147477504:12345-0@lo:400: Request processed in 30us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651726.305272:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788651726.305288:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147477120 00000100:00100000:0.0:1788651726.305291:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147477120 00000100:00100000:0.0:1788651726.305310:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788651726.305316:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006422fe01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147477120:12345-0@lo:400: 00000100:00100000:0.0:1788651726.305342:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006422fe01 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147477120:12345-0@lo:400: Request processed in 26us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651726.305356:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788651726.305403:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000ebbb0cd1 x1875537147477120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651726.305414:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ebbb0cd1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147477120:0@lo:400: 00000100:00100000:0.0:1788651726.305422:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a9a9a96f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147476992:0@lo:400: 00000100:00100000:0.0:1788651726.305430:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015553787 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147477504:0@lo:400: 00010000:00010000:1.0:1788651726.306810:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651726.308027:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651726.308065:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d73fbda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147477632:0@lo:41: 00000100:00100000:0.0:1788651726.308184:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651726.308462:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147477632 00000100:00100000:1.0:1788651726.308471:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147477632 00000100:00100000:1.0:1788651726.308526:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788651726.308535:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069ffa9f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147477632:12345-0@lo:41: 00000004:00000024:1.0:1788651726.308579:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1788651726.308638:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069ffa9f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147477632:12345-0@lo:41: Request processed in 104us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651726.308645:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788651726.308810:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e5173943 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147477248:0@lo:400: 00000100:00100000:0.0:1788651726.308851:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d73fbda pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147477632:0@lo:41: 00010000:00010000:3.0:1788651727.328278:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651727.841265:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002f2edfae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147477760:0@lo:41: 00000100:00100000:0.0:1788651727.841361:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651727.841575:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147477760 00000100:00100000:3.0:1788651727.841585:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147477760 00000100:00100000:3.0:1788651727.841639:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788651727.841647:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d73fbda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147477760:12345-0@lo:41: 00000004:00000024:3.0:1788651727.841685:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788651727.841740:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d73fbda pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147477760:12345-0@lo:41: Request processed in 95us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651727.841747:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788651727.841823:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002f2edfae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147477760:0@lo:41: 00010000:00010000:0.0:1788651728.353238:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651729.378005:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651730.402390:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788651730.912317:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788651730.912326:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86f48d9800 from 1 10000000:01000000:0.0:1788651730.912331:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788651730.912378:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: 00000000becb64df/0xcd2f56ea038c394c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651730.912391:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: 00000000becb64df/0xcd2f56ea038c394c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651730.912403:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: 00000000becb64df/0xcd2f56ea038c394c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651730.912429:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000299aeee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147477888:0@lo:101: 00000100:00100000:0.0:1788651730.912510:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651730.912557:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d4c1e1b9 going to sleep for 11 seconds 00000100:00100000:1.0:1788651730.912621:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147477888 00000100:00100000:1.0:1788651730.912629:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147477888 00000100:00100000:1.0:1788651730.912683:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788651730.912692:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a59ca0b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147477888:12345-0@lo:101: 00010000:00010000:1.0:1788651730.912704:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651730.912718:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001751657c/0xcd2f56ea038c3953 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c394c expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651730.912740:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001751657c/0xcd2f56ea038c3953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c394c expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651730.912749:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001751657c/0xcd2f56ea038c3953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c394c expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651730.912757:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001751657c, rc 0) 00000100:00100000:1.0:1788651730.912797:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a59ca0b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147477888:12345-0@lo:101: Request processed in 107us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651730.912803:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788651730.912842:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000299aeee pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147477888:0@lo:101: 00010000:00010000:1.0:1788651730.912854:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: 00000000becb64df/0xcd2f56ea038c394c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651730.912871:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: 00000000becb64df/0xcd2f56ea038c394c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651730.912963:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f142120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147478016:0@lo:501: 00000100:00100000:1.0:1788651730.912985:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651730.912997:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061a0e194 going to sleep for 11 seconds 00000100:00100000:1.0:1788651730.913008:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147478016 00000100:00100000:1.0:1788651730.913011:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147478016 00000100:00100000:1.0:1788651730.913030:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788651730.913035:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5b59811 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147478016:12345-0@lo:501: 00000100:00100000:1.0:1788651730.913134:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5b59811 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147478016:12345-0@lo:501: Request processed in 98us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651730.913140:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788651730.913168:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f142120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147478016:0@lo:501: 00000100:00100000:1.0:1788651730.913203:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f142120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147478144:0@lo:503: 00000100:00100000:1.0:1788651730.913233:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651730.913244:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set 0000000061a0e194 going to sleep for 11 seconds 00000100:00100000:1.0:1788651730.913254:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147478144 00000100:00100000:1.0:1788651730.913257:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147478144 00000100:00100000:1.0:1788651730.913273:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788651730.913290:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b8d1a05e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147478144:12345-0@lo:503: 00000100:00100000:1.0:1788651730.913355:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b8d1a05e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147478144:12345-0@lo:503: Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651730.913362:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788651730.913396:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f142120 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147478144:0@lo:503: 00000100:00100000:1.0:1788651730.913560:0:8240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009f142120 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8240:1875537147478272:0@lo:502: 00000100:00100000:1.0:1788651730.913589:0:8240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651730.913607:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147478272 00000100:00100000:1.0:1788651730.913610:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147478272 00000100:00100000:1.0:1788651730.913630:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788651730.913635:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024982169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:8240:x1875537147478272:12345-0@lo:502: 00000100:00100000:1.0:1788651730.913702:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024982169 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:8240:x1875537147478272:12345-0@lo:502: Request processed in 66us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651730.913708:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788651730.913735:0:8240:0:(client.c:2716:ptlrpc_set_wait()) set 000000009c712147 going to sleep for 11 seconds 00000100:00100000:1.0:1788651730.913746:0:8240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009f142120 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8240:1875537147478272:0@lo:502: 00000020:01000000:1.0:1788651730.913765:0:8240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651730.913773:0:8240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651730.913775:0:8240:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788651730.913780:0:8240:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86f48d9800 00000020:00000080:1.0:1788651730.913782:0:8240:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788651730.913817:0:8240:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8240:1875537147478400:0@lo:502: 00000100:00100000:1.0:1788651730.913847:0:8240:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651730.913865:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147478400 00000100:00100000:1.0:1788651730.913869:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147478400 00000100:00100000:1.0:1788651730.913889:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788651730.913894:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:8240:x1875537147478400:12345-0@lo:502: 00000100:00100000:1.0:1788651730.913969:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:8240:x1875537147478400:12345-0@lo:502: Request processed in 74us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651730.913976:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788651730.914000:0:8240:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6437180 going to sleep for 11 seconds 00000100:00100000:1.0:1788651730.914010:0:8240:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8240:1875537147478400:0@lo:502: 00000020:01000000:1.0:1788651730.914029:0:8240:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651730.914033:0:8240:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651730.914035:0:8240:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788651730.914038:0:8240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1788651730.914081:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788651730.914094:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788651730.914102:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c394c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651730.914110:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651730.914119:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788651730.914122:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86da667000 from 1 10000000:01000000:1.0:1788651730.914125:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788651730.914142:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651730.914150:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651730.914157:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651730.914168:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147478528:0@lo:101: 00000100:00100000:1.0:1788651730.914191:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651730.914204:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6437180 going to sleep for 11 seconds 00000100:00100000:1.0:1788651730.914215:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147478528 00000100:00100000:1.0:1788651730.914218:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147478528 00000100:00100000:1.0:1788651730.914239:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788651730.914244:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147478528:12345-0@lo:101: 00010000:00010000:1.0:1788651730.914257:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651730.914267:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3961 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c395a expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651730.914296:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c395a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651730.914305:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c395a expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651730.914313:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dc400, rc 0) 00000100:00100000:1.0:1788651730.914338:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147478528:12345-0@lo:101: Request processed in 94us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651730.914344:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788651730.914370:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147478528:0@lo:101: 00010000:00010000:1.0:1788651730.914380:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651730.914388:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651730.914424:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147478656:0@lo:501: 00000100:00100000:1.0:1788651730.914447:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651730.914457:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6437180 going to sleep for 11 seconds 00000100:00100000:1.0:1788651730.914467:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147478656 00000100:00100000:1.0:1788651730.914470:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147478656 00000100:00100000:1.0:1788651730.914487:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788651730.914492:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147478656:12345-0@lo:501: 00000100:00100000:1.0:1788651730.914565:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147478656:12345-0@lo:501: Request processed in 72us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651730.914572:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788651730.914597:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147478656:0@lo:501: 00000100:00100000:1.0:1788651730.914617:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147478784:0@lo:503: 00000100:00100000:1.0:1788651730.914646:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651730.914656:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6437180 going to sleep for 11 seconds 00000100:00100000:1.0:1788651730.914665:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147478784 00000100:00100000:1.0:1788651730.914668:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147478784 00000100:00100000:1.0:1788651730.914684:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788651730.914689:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147478784:12345-0@lo:503: 00000100:00100000:1.0:1788651730.914742:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147478784:12345-0@lo:503: Request processed in 53us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651730.914747:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788651730.914780:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147478784:0@lo:503: 00000100:00100000:3.0:1788651730.921452:0:8241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8241:1875537147478912:0@lo:502: 00000100:00100000:3.0:1788651730.921544:0:8241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651730.921586:0:8241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651730.922056:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147478912 00000100:00100000:1.0:1788651730.922065:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147478912 00000100:00100000:1.0:1788651730.922120:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788651730.922130:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:8241:x1875537147478912:12345-0@lo:502: 00000100:00100000:1.0:1788651730.922254:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:8241:x1875537147478912:12345-0@lo:502: Request processed in 125us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651730.922262:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788651730.922329:0:8241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8241:1875537147478912:0@lo:502: 00000020:01000000:1.0:1788651730.922356:0:8241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651730.922365:0:8241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651730.922371:0:8241:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788651730.922377:0:8241:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86da667000 00000020:00000080:1.0:1788651730.922379:0:8241:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788651730.922401:0:8241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8241:1875537147479040:0@lo:502: 00000100:00100000:1.0:1788651730.922433:0:8241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651730.922450:0:8241:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6437480 going to sleep for 11 seconds 00000100:00100000:3.0:1788651730.922583:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147479040 00000100:00100000:3.0:1788651730.922589:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147479040 00000100:00100000:3.0:1788651730.922621:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788651730.922627:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:8241:x1875537147479040:12345-0@lo:502: 00000100:00100000:3.0:1788651730.922697:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:8241:x1875537147479040:12345-0@lo:502: Request processed in 70us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651730.922704:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788651730.923456:0:8241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8241:1875537147479040:0@lo:502: 00000020:01000000:1.0:1788651730.923488:0:8241:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651730.923496:0:8241:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651730.923498:0:8241:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788651730.923503:0:8241:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788651730.923676:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788651730.923698:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788651730.923708:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651730.923720:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651731.424397:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147479552:0@lo:400: 00000100:00100000:0.0:1788651731.424462:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651731.424521:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788651731.424527:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147479168:0@lo:400: 00000100:00100000:0.0:1788651731.424553:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651731.424576:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147479680:0@lo:400: 00000100:00100000:0.0:1788651731.424606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651731.424629:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147479296:0@lo:400: 00000100:00100000:0.0:1788651731.424648:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651731.424662:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651731.424667:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147479424:0@lo:400: 00000100:00100000:0.0:1788651731.424685:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651731.424712:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147479168 00000100:00100000:0.0:1788651731.424718:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147479168 00000100:00100000:0.0:1788651731.424762:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788651731.424770:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:3637:x1875537147479168:12345-0@lo:400: 00000100:00100000:0.0:1788651731.424815:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:3637:x1875537147479168:12345-0@lo:400: Request processed in 46us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651731.424821:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788651731.424864:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147479680 00000100:00100000:0.0:1788651731.424868:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147479680 00000100:00100000:0.0:1788651731.424889:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147479424 00000100:00100000:0.0:1788651731.424892:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147479424 00000100:00100000:0.0:1788651731.424903:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788651731.424949:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147479680:12345-0@lo:400: 00000100:00100000:0.0:1788651731.424985:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147479680:12345-0@lo:400: Request processed in 37us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651731.424990:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788651731.425000:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788651731.425005:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147479424:12345-0@lo:400: 00000100:00100000:0.0:1788651731.425030:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147479424:12345-0@lo:400: Request processed in 25us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651731.425035:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788651731.425049:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147479552 00000100:00100000:0.0:1788651731.425053:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147479552 00000100:00100000:0.0:1788651731.425071:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147479296 00000100:00100000:0.0:1788651731.425087:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147479296 00000100:00100000:0.0:1788651731.425102:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788651731.425107:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147479552:12345-0@lo:400: 00000100:00100000:0.0:1788651731.425133:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147479552:12345-0@lo:400: Request processed in 26us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651731.425138:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788651731.425149:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788651731.425154:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147479296:12345-0@lo:400: 00000100:00100000:0.0:1788651731.425177:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147479296:12345-0@lo:400: Request processed in 24us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651731.425182:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788651731.425278:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147479808:0@lo:41: 00000100:00100000:0.0:1788651731.425302:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651731.425332:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147479424:0@lo:400: 00010000:00080000:0.0:1788651731.425345:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86ea15f480 x1875537147479296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651731.425361:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147479296:0@lo:400: 00000100:00100000:0.0:1788651731.425385:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147479808 00000100:00100000:0.0:1788651731.425388:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147479808 00000100:00100000:0.0:1788651731.425406:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788651731.425428:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147479808:12345-0@lo:41: 00000004:00000024:0.0:1788651731.425452:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788651731.425486:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147479808:12345-0@lo:41: Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651731.425492:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788651731.425521:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147479808:0@lo:41: 00000100:00100000:0.0:1788651731.425543:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147479168:0@lo:400: 00000100:00100000:0.0:1788651731.425565:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147479680:0@lo:400: 00010000:00080000:0.0:1788651731.425575:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86ea15d880 x1875537147479552/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651747 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651731.425583:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147479552:0@lo:400: 00010000:00010000:2.0:1788651731.426058:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651732.455285:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651732.961024:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651732.961049:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147479936:0@lo:41: 00000100:00100000:0.0:1788651732.961124:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651732.961269:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147479936 00000100:00100000:3.0:1788651732.961278:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147479936 00000100:00100000:3.0:1788651732.961331:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788651732.961342:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147479936:12345-0@lo:41: 00000004:00000024:3.0:1788651732.961375:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:3.0:1788651732.961433:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147479936:12345-0@lo:41: Request processed in 93us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651732.961440:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788651732.961513:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147479936:0@lo:41: 00010000:00010000:0.0:1788651733.474692:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788651734.400239:0:8420:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788651734.400244:0:8420:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788651734.400246:0:8420:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788651734.400377:0:8420:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f86eeab9800 00000020:01000004:3.0:1788651734.400392:0:8420:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788651734.400404:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788651734.400416:0:8420:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f86f56099c0) 00000020:00000080:3.0:1788651734.400434:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788651734.473330:0:8420:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788651734.473384:0:8420:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00010000:00010000:0.0:1788651734.502158:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:01000000:2.0:1788651734.530816:0:8420:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788651734.531364:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788651734.531378:0:8420:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788651734.531390:0:8420:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd2f56ea038c396f 00000020:01000004:0.0:1788651734.531397:0:8420:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788651734.531432:0:8420:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.145@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788651734.531436:0:8420:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788651734.531442:0:8420:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788651734.531447:0:8420:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788651734.531468:0:8420:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f86fcd74d40) 00000020:00000080:0.0:1788651734.531480:0:8420:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:0.0:1788651734.537858:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788651734.539314:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788651734.539323:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788651734.543362:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788651734.543373:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788651734.544859:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788651734.544868:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788651734.548683:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788651734.548890:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788651734.548896:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788651734.551600:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788651734.551614:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788651734.590714:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788651734.590994:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788651734.591000:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788651734.594795:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788651734.594812:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788651734.599696:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788651734.599712:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788651734.605709:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788651734.606079:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788651734.606086:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788651734.614181:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788651734.614198:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788651734.721040:0:8420:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788651734.721271:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788651734.721278:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788651734.728413:0:8420:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788651734.728600:0:8420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788651734.735481:0:8420:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788651734.735517:0:8420:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788651734.735524:0:8420:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788651734.768421:0:8420:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788651734.768463:0:8420:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.145@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788651734.768468:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788651734.768470:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788651734.768471:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651734.768472:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788651734.768474:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651734.768475:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651734.768476:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788651734.768478:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788651734.768479:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788651734.768481:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651734.768482:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788651734.768486:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788651734.768489:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788651734.768490:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788651734.768492:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651734.768492:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788651734.768494:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651734.768495:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651734.768495:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788651734.768497:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788651734.768497:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788651734.768498:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651734.768505:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788651734.768712:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788651734.768731:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147480064:0@lo:253: 00000100:00100000:0.0:1788651734.768867:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651734.769185:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbcd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651734.769235:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147480064 00000100:00100000:1.0:1788651734.769245:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147480064 00000100:00100000:1.0:1788651734.769299:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788651734.769308:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:8420:x1875537147480064:12345-0@lo:253: 20000000:01000000:1.0:1788651734.769352:0:6502:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788651734.769356:0:6502:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788651734.769361:0:6502:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788651734.769364:0:6502:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788651734.770403:0:6502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788651734.770721:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788651734.770737:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788651734.770835:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788651734.770843:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788651734.770858:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788651734.770872:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788651734.771174:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788651734.771190:0:6502:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.145@tcp 20000000:01000000:0.0:1788651734.771192:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.145@tcp (null) (null) (null) 00000040:00080000:0.0:1788651734.771219:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788651734.771227:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788651734.771242:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788651734.771248:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.145@tcp (null) (null) 00000040:00080000:0.0:1788651734.771261:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788651734.771267:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788651734.771278:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788651734.771291:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788651734.771355:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:0.0:1788651734.771365:0:6502:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.145@tcp 20000000:01000000:0.0:1788651734.771367:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.145@tcp (null) (null) (null) 00000040:00080000:0.0:1788651734.771382:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:0.0:1788651734.771387:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788651734.771399:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:0.0:1788651734.771404:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.204.145@tcp (null) (null) 00000040:00080000:0.0:1788651734.771417:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:0.0:1788651734.771434:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788651734.771446:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:0.0:1788651734.771461:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:0.0:1788651734.772218:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:0.0:1788651734.772235:0:6502:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.145@tcp 20000000:01000000:0.0:1788651734.772237:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.145@tcp (null) (null) (null) 00000040:00080000:0.0:1788651734.772268:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:0.0:1788651734.772275:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788651734.772289:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:0.0:1788651734.772294:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.145@tcp (null) (null) 00000040:00080000:0.0:1788651734.772306:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:0.0:1788651734.772313:0:6502:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788651734.772325:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:0.0:1788651734.772338:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:0.0:1788651734.772352:0:6502:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788651734.772355:0:6502:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788651734.772358:0:6502:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788651734.772413:0:6502:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788651734.772416:0:6502:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788651734.773231:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:3.0:1788651734.773265:0:8439:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:3.0:1788651734.773283:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788651734.773490:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788651734.773509:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788651734.774169:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788651734.774186:0:6502:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788651734.774189:0:6502:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788651734.774587:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 19 1->4: lustre sys.timeout 20000000:01000000:3.0:1788651734.774692:0:8440:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 19 2->4: lustre sys.timeout 00000040:00080000:3.0:1788651734.774708:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788651734.777409:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1788651734.777440:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1788651734.777453:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1788651734.777467:0:6502:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788651734.777470:0:6502:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788651734.778172:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:0.0:1788651734.778215:0:8441:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:0.0:1788651734.778233:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1788651734.778397:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1788651734.778414:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1788651734.778426:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1788651734.778450:0:6502:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788651734.778452:0:6502:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788651734.778760:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788651734.779612:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788651734.779641:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788651734.779655:0:6502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1788651734.779673:0:6502:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788651734.779694:0:6502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.779713:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3842 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.779721:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c38c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c38b9 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.779728:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c38f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c38f1 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.779734:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da4600/0xcd2f56ea038c3914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c390d expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.779740:0:6502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c393e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3937 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.780085:0:6502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.780128:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c393e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3937 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.780144:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c393e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3937 expref: 18 pid: 6504 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651734.780175:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6502:1875537147480192:0@lo:104: 00000100:00100000:3.0:1788651734.780250:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651734.780312:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da4600/0xcd2f56ea038c3914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c390d expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.780320:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86e7da4600/0xcd2f56ea038c3914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c390d expref: 18 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651734.780327:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6502:1875537147480320:0@lo:104: 00000100:00100000:3.0:1788651734.780347:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651734.780377:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c38f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c38f1 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.780386:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c38f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c38f1 expref: 18 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651734.780394:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6502:1875537147480448:0@lo:104: 00000100:00100000:3.0:1788651734.780426:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651734.780447:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c38c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c38b9 expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.780455:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c38c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c38b9 expref: 18 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651734.780463:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a35500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6502:1875537147480576:0@lo:104: 00000100:00100000:3.0:1788651734.780483:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651734.780500:0:6502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3842 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.780519:0:6502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3849 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3842 expref: 18 pid: 6504 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651734.780529:0:6502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a37100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6502:1875537147480704:0@lo:104: 00000100:00100000:3.0:1788651734.780552:0:6502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651734.780562:0:6502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d1349600 going to sleep for 11 seconds 00000100:00100000:1.0:1788651734.780708:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147480192 00000100:00100000:1.0:1788651734.780715:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147480192 00000100:00100000:1.0:1788651734.780763:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147480320 00000100:00100000:1.0:1788651734.780766:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147480320 00000100:00100000:1.0:1788651734.780778:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147480448 00000100:00100000:1.0:1788651734.780787:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147480448 00000100:00100000:1.0:1788651734.780802:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147480576 00000100:00100000:1.0:1788651734.780804:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147480576 00000100:00100000:1.0:1788651734.780812:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147480704 00000100:00100000:1.0:1788651734.780815:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147480704 00000100:00100000:1.0:1788651734.780826:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788651734.780834:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+7:6502:x1875537147480192:12345-0@lo:104: 00010000:00010000:1.0:1788651734.780846:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c1502a00/0xcd2f56ea038c3937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.780931:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788651734.780938:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+7:6502:x1875537147480192:12345-0@lo:104: Request processed in 104us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.780945:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788651734.780961:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788651734.780968:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:6502:x1875537147480320:12345-0@lo:104: 00010000:00010000:1.0:1788651734.780976:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c390d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781011:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788651734.781017:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:6502:x1875537147480320:12345-0@lo:104: Request processed in 50us (669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.781023:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788651734.781033:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788651734.781039:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:6502:x1875537147480448:12345-0@lo:104: 00010000:00010000:1.0:1788651734.781046:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c38f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781079:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788651734.781090:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:6502:x1875537147480448:12345-0@lo:104: Request processed in 51us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.781097:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788651734.781110:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788651734.781116:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6502:x1875537147480576:12345-0@lo:104: 00010000:00010000:1.0:1788651734.781124:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c38b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781153:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788651734.781158:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6502:x1875537147480576:12345-0@lo:104: Request processed in 43us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.781163:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788651734.781174:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651734.781180:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6502:x1875537147480704:12345-0@lo:104: 00010000:00010000:1.0:1788651734.781187:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781242:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788651734.781248:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6502:x1875537147480704:12345-0@lo:104: Request processed in 68us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.781253:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1788651734.781270:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788651734.781275:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1502a00/0xcd2f56ea038c3937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781282:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502a00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651734.781287:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502a00/0xcd2f56ea038c3937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781306:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1502a00/0xcd2f56ea038c3937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651734.781314:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502a00/0xcd2f56ea038c3937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651734.781320:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651734.781350:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c1502a00/0xcd2f56ea038c3937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781357:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651734.781375:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502a00/0xcd2f56ea038c3937 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781382:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1502a00/0xcd2f56ea038c3937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c393e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781397:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788651734.781401:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c390d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781406:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651734.781409:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c390d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781416:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c390d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651734.781422:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c390d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651734.781435:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651734.781450:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c390d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781456:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651734.781462:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c390d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781468:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c390d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3914 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781478:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788651734.781481:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c38f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781486:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651734.781489:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c38f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781495:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c38f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651734.781502:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c38f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651734.781507:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651734.781529:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c38f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781535:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651734.781553:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c38f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781559:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c38f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38f8 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781569:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788651734.781572:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c38b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781578:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503a00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651734.781580:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c38b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781587:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c38b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651734.781593:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c38b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651734.781598:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651734.781611:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c38b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781617:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651734.781621:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c38b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781627:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c38b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38c0 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781635:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651734.781644:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781650:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651734.781653:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781659:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651734.781666:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651734.781671:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651734.781683:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3842 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781688:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651734.781692:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3842 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781697:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3849 expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.781707:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651734.781709:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651734.781711:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651734.781718:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651734.781723:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651734.781733:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147480832:0@lo:103: 00000100:00100000:1.0:1788651734.781765:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.781789:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147481344:0@lo:103: 00000100:00100000:1.0:1788651734.781809:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.781828:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651734.781833:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147480960:0@lo:103: 00000100:00100000:1.0:1788651734.781850:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.781876:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147481088:0@lo:103: 00000100:00100000:1.0:1788651734.781895:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.781930:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651734.781935:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147481216:0@lo:103: 00000100:00100000:1.0:1788651734.781970:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.781996:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147480832 00000100:00100000:1.0:1788651734.782001:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147480832 00010000:00010000:1.0:1788651734.782023:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c393e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3937 expref: 19 pid: 6504 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651734.782043:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147481344 00000100:00100000:1.0:1788651734.782045:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147481344 00010000:00010000:1.0:1788651734.782055:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3849 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3842 expref: 20 pid: 6504 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651734.782064:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147480960 00000100:00100000:1.0:1788651734.782067:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147480960 00010000:00010000:1.0:1788651734.782076:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da4600/0xcd2f56ea038c3914 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c390d expref: 21 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651734.782085:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147481088 00000100:00100000:1.0:1788651734.782087:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147481088 00010000:00010000:1.0:1788651734.782095:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c38f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c38f1 expref: 22 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651734.782104:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147481216 00000100:00100000:1.0:1788651734.782110:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147481216 00010000:00010000:1.0:1788651734.782121:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c38c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c38b9 expref: 23 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651734.782132:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788651734.782138:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:3637:x1875537147480832:12345-0@lo:103: 00010000:00010000:1.0:1788651734.782148:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651734.782153:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c393e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3937 expref: 23 pid: 6504 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782163:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c393e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3937 expref: 23 pid: 6504 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782178:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651734.782220:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:3637:x1875537147480832:12345-0@lo:103: Request processed in 82us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.782228:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788651734.782240:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788651734.782246:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3637:x1875537147481344:12345-0@lo:103: 00010000:00010000:1.0:1788651734.782261:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651734.782265:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3849 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3842 expref: 22 pid: 6504 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782274:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3849 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3842 expref: 22 pid: 6504 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782283:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651734.782303:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3637:x1875537147481344:12345-0@lo:103: Request processed in 57us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.782310:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788651734.782327:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788651734.782333:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3637:x1875537147480960:12345-0@lo:103: 00010000:00010000:1.0:1788651734.782340:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651734.782345:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da4600/0xcd2f56ea038c3914 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c390d expref: 21 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782353:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da4600/0xcd2f56ea038c3914 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c390d expref: 21 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782361:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651734.782379:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3637:x1875537147480960:12345-0@lo:103: Request processed in 47us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.782385:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788651734.782394:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788651734.782399:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:3635:x1875537147481088:12345-0@lo:103: 00010000:00010000:1.0:1788651734.782405:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651734.782409:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c38f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c38f1 expref: 20 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782417:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c38f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c38f1 expref: 20 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782425:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651734.782445:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:3635:x1875537147481088:12345-0@lo:103: Request processed in 46us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.782451:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788651734.782461:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651734.782467:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d2868450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:3635:x1875537147481216:12345-0@lo:103: 00010000:00010000:1.0:1788651734.782473:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651734.782482:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c38c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c38b9 expref: 19 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782491:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c38c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c38b9 expref: 19 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782502:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782510:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782523:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782531:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782537:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782544:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782549:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651734.782554:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782562:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782570:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.782589:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651734.782609:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d2868450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:3635:x1875537147481216:12345-0@lo:103: Request processed in 142us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.782614:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651734.782665:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147481216:0@lo:103: 00000100:00100000:1.0:1788651734.782673:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147481088:0@lo:103: 00000100:00100000:1.0:1788651734.782692:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147480960:0@lo:103: 00000100:00100000:1.0:1788651734.782699:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147480832:0@lo:103: 00000100:00100000:1.0:1788651734.782706:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147481344:0@lo:103: 00010000:00010000:3.0:1788651734.783182:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c393e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3937 expref: 18 pid: 6504 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651734.783197:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15ea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6502:1875537147480192:0@lo:104: 00010000:00010000:3.0:1788651734.783220:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4600/0xcd2f56ea038c3914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c390d expref: 17 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651734.783227:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6502:1875537147480320:0@lo:104: 00010000:00010000:3.0:1788651734.783234:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c38f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c38f1 expref: 16 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651734.783240:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6502:1875537147480448:0@lo:104: 00010000:00010000:3.0:1788651734.783247:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c38c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c38b9 expref: 15 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651734.783253:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a35500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6502:1875537147480576:0@lo:104: 00010000:00010000:3.0:1788651734.783261:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3842 expref: 14 pid: 6504 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651734.783268:0:6502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a37100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6502:1875537147480704:0@lo:104: 00010000:00010000:3.0:1788651734.783287:0:6502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.783303:0:6502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.783310:0:6502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.783317:0:6502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c397d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788651734.783330:0:6502:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788651734.793724:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:8420:x1875537147480064:12345-0@lo:253: Request processed in 24408us (24849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651734.793737:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788651734.794137:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147480064:0@lo:253: 10000000:01000000:2.0:1788651734.794153:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788651734.794157:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788651734.794158:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788651734.794160:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788651734.794161:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788651734.794163:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788651734.794165:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788651734.794166:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788651734.794168:0:8420:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788651734.794169:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788651734.794170:0:8420:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788651734.794191:0:8420:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f86eeab9800 from lustre-OST0000 10000000:01000000:2.0:1788651734.794232:0:8420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788651734.794235:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788651734.794243:0:8420:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f86da6c3380 local copy 10000000:01000000:2.0:1788651734.794247:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788651734.794284:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.794308:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.794318:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651734.794336:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147481472:0@lo:101: 00000100:00100000:2.0:1788651734.794385:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651734.794424:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000600 going to sleep for 11 seconds 00000100:00100000:0.0:1788651734.794534:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147481472 00000100:00100000:0.0:1788651734.794547:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147481472 00000100:00100000:0.0:1788651734.794600:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788651734.794610:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:8420:x1875537147481472:12345-0@lo:101: 00010000:00010000:0.0:1788651734.794622:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651734.794634:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c398b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3984 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651734.794656:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c398b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3984 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651734.794667:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c398b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3984 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651734.794676:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5800, rc 0) 00000100:00100000:0.0:1788651734.794713:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147481472:12345-0@lo:101: Request processed in 105us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651734.794719:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788651734.795192:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147481472:0@lo:101: 00010000:00010000:2.0:1788651734.795216:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.795225:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651734.795320:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147481600:0@lo:501: 00000100:00100000:2.0:1788651734.795347:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651734.795406:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000600 going to sleep for 11 seconds 00000100:00100000:0.0:1788651734.797684:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147481600 00000100:00100000:0.0:1788651734.797699:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147481600 00000100:00100000:0.0:1788651734.797865:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788651734.797876:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147481600:12345-0@lo:501: 00000100:00100000:0.0:1788651734.798436:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147481600:12345-0@lo:501: Request processed in 561us (3086us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788651734.798443:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788651734.798541:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147481600:0@lo:501: 10000000:01000000:2.0:1788651734.798565:0:8420:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788651734.798590:0:8420:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788651734.798611:0:8420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.798621:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.798646:0:8420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.798674:0:8420:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788651734.798708:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f86eeab9800 10000000:01000000:2.0:1788651734.798713:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788651734.798720:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788651734.798723:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788651734.798727:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788651734.798730:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788651734.798770:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.798779:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.798788:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651734.798808:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147481728:0@lo:101: 00000100:00100000:2.0:1788651734.798842:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651734.798877:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651734.798884:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.798892:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f8800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651734.798926:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.798936:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651734.798944:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651734.798949:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788651734.798968:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.798975:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651734.798993:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.799007:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c3984 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd2f56ea038c398b expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.799019:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651734.799021:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651734.799023:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651734.799035:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147481856:0@lo:103: 00000100:00100000:3.0:1788651734.799063:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651734.799128:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147481856 00000100:00100000:3.0:1788651734.799134:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147481856 00000100:00100000:3.0:1788651734.799186:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651734.799193:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:3638:x1875537147481856:12345-0@lo:103: 00010000:00010000:3.0:1788651734.799217:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651734.799230:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c398b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3984 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.799245:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651734.799275:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:3638:x1875537147481856:12345-0@lo:103: Request processed in 82us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651734.799281:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651734.799308:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147481856:0@lo:103: 00000100:00100000:2.0:1788651734.800524:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651734.800740:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147481728 00000100:00100000:1.0:1788651734.800757:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147481728 00000100:00100000:1.0:1788651734.800797:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788651734.800804:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+13:8420:x1875537147481728:12345-0@lo:101: 00010000:00010000:1.0:1788651734.800817:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651734.800835:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c3999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3992 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.800858:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c3999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3992 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.800869:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c3999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3992 expref: 14 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.800877:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dd400, rc 0) 00000100:00100000:1.0:1788651734.801227:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147481728:12345-0@lo:101: Request processed in 422us (2383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.801246:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788651734.801350:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147481728:0@lo:101: 00010000:00010000:2.0:1788651734.801366:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.801376:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651734.801492:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147481984:0@lo:501: 00000100:00100000:2.0:1788651734.801537:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651734.801640:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651734.801855:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147481984 00000100:00100000:0.0:1788651734.801861:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147481984 00000100:00100000:1.0:1788651734.802040:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788651734.802050:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147481984:12345-0@lo:501: 00000100:00100000:1.0:1788651734.802175:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147481984:12345-0@lo:501: Request processed in 127us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.802182:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788651734.802542:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147481984:0@lo:501: 00000100:00100000:2.0:1788651734.802576:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482112:0@lo:503: 00000100:00100000:2.0:1788651734.802757:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651734.802785:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651734.804974:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147482112 00000100:00100000:1.0:1788651734.804987:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147482112 00000100:00100000:1.0:1788651734.805036:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788651734.805044:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147482112:12345-0@lo:503: 00000100:00100000:1.0:1788651734.805193:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147482112:12345-0@lo:503: Request processed in 148us (2445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.805211:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788651734.805487:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482112:0@lo:503: 00000040:00080000:2.0:1788651734.806088:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788651734.806178:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482240:0@lo:502: 00000100:00100000:2.0:1788651734.806239:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651734.806275:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651734.806454:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147482240 00000100:00100000:1.0:1788651734.806461:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147482240 00000100:00100000:1.0:1788651734.806490:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788651734.806498:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147482240:12345-0@lo:502: 00000100:00100000:1.0:1788651734.810028:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147482240:12345-0@lo:502: Request processed in 3520us (3779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.810045:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788651734.810448:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482240:0@lo:502: 00000040:00080000:2.0:1788651734.811472:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788651734.811547:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788651734.811568:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788651734.811585:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788651734.811613:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788651734.811628:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788651734.811669:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482368:0@lo:502: 00000100:00100000:2.0:1788651734.811736:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651734.812019:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147482368 00000100:00100000:0.0:1788651734.812027:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147482368 00000100:00100000:0.0:1788651734.812064:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788651734.812072:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147482368:12345-0@lo:502: 00000100:00100000:0.0:1788651734.812185:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147482368:12345-0@lo:502: Request processed in 113us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651734.812193:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788651734.812305:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651734.812324:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482368:0@lo:502: 00000040:00080000:2.0:1788651734.812375:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788651734.812389:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788651734.813251:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788651734.813261:0:8443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1788651734.813268:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651734.813271:0:8443:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788651734.813277:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788651734.813292:0:8443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f86fb24cd40) 00000020:00000080:2.0:1788651734.813317:0:8443:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788651734.813324:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788651734.813393:0:8443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86eeab9800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788651734.813402:0:8443:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788651734.813421:0:8443:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd2f56ea038c39a7 00010000:00010000:2.0:1788651734.825416:0:8443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:2.0:1788651734.825764:0:8443:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788651734.831051:0:8443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788651734.831390:0:8443:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788651734.837158:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:2.0:1788651734.837364:0:8443:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788651734.845432:0:8443:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788651734.846642:0:8443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788651734.846654:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651734.846661:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651734.846663:0:8443:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788651734.846667:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651734.846670:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651734.846677:0:8443:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788651734.846681:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788651734.846683:0:8443:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788651734.846709:0:8443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651734.846713:0:8443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651734.846714:0:8443:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788651734.846717:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788651734.846866:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788651734.846890:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788651734.846943:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.846955:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651734.846970:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86eeab9800 from 1 10000000:01000000:1.0:1788651734.846973:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788651734.847009:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.847018:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.847028:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651734.847050:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482496:0@lo:101: 00000100:00100000:1.0:1788651734.847113:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.847156:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ed85e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788651734.848872:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147482496 00000100:00100000:0.0:1788651734.848884:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147482496 00000100:00100000:1.0:1788651734.849862:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788651734.849876:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:8420:x1875537147482496:12345-0@lo:101: 00010000:00010000:1.0:1788651734.849891:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651734.849950:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c29dda00/0xcd2f56ea038c39b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c39ae expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.849977:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c29dda00/0xcd2f56ea038c39b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c39ae expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.849988:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c29dda00/0xcd2f56ea038c39b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c39ae expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.849997:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dda00, rc 0) 00000100:00100000:1.0:1788651734.850065:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8420:x1875537147482496:12345-0@lo:101: Request processed in 194us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.850080:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788651734.850136:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482496:0@lo:101: 00010000:00010000:1.0:1788651734.850152:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.850161:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651734.850273:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482624:0@lo:501: 00000100:00100000:1.0:1788651734.850304:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.850334:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147482624 00000100:00100000:1.0:1788651734.850339:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147482624 00000100:00100000:1.0:1788651734.850363:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788651734.850370:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8420:x1875537147482624:12345-0@lo:501: 00000100:00100000:1.0:1788651734.850452:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8420:x1875537147482624:12345-0@lo:501: Request processed in 81us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.850460:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788651734.850493:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ed85e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788651734.850505:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482624:0@lo:501: 00000100:00100000:1.0:1788651734.850543:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482752:0@lo:503: 00000100:00100000:1.0:1788651734.850578:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.850596:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147482752 00000100:00100000:1.0:1788651734.850599:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147482752 00000100:00100000:1.0:1788651734.850620:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788651734.850627:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8420:x1875537147482752:12345-0@lo:503: 00000100:00100000:1.0:1788651734.850694:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8420:x1875537147482752:12345-0@lo:503: Request processed in 67us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.850705:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788651734.850738:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788651734.850750:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482752:0@lo:503: 00000040:00080000:1.0:1788651734.850973:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788651734.851035:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482880:0@lo:502: 00000100:00100000:1.0:1788651734.851065:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.851086:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147482880 00000100:00100000:1.0:1788651734.851089:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147482880 00000100:00100000:1.0:1788651734.851111:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788651734.851116:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8420:x1875537147482880:12345-0@lo:502: 00000100:00100000:1.0:1788651734.851174:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8420:x1875537147482880:12345-0@lo:502: Request processed in 58us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.851181:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788651734.851220:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788651734.851231:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147482880:0@lo:502: 00000040:00080000:1.0:1788651734.851391:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788651734.851412:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788651734.851428:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483008:0@lo:502: 00000100:00100000:1.0:1788651734.851455:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.851472:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147483008 00000100:00100000:1.0:1788651734.851475:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147483008 00000100:00100000:1.0:1788651734.851492:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788651734.851497:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8420:x1875537147483008:12345-0@lo:502: 00000100:00100000:1.0:1788651734.851544:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8420:x1875537147483008:12345-0@lo:502: Request processed in 46us (87us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.851550:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788651734.851577:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788651734.851587:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483008:0@lo:502: 00000040:00080000:1.0:1788651734.851619:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788651734.851627:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788651734.851844:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651734.851851:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651734.851854:0:8447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788651734.851859:0:8447:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86eeab9800 00000020:00000080:1.0:1788651734.851861:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788651734.851870:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651734.851872:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651734.851873:0:8447:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788651734.851876:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788651734.851900:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788651734.851935:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788651734.853620:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.853634:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651734.853692:0:8420:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788651734.853695:0:8420:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f86eeab9800 10000000:01000000:1.0:1788651734.853697:0:8420:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f86eeab9800 10000000:01000000:1.0:1788651734.853700:0:8420:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788651734.853705:0:8420:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86eeab9800 from 1 10000000:01000000:1.0:1788651734.853708:0:8420:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788651734.853741:0:8420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.853749:0:8420:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.853766:0:8420:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651734.853785:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483136:0@lo:101: 00000100:00100000:1.0:1788651734.853839:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.853946:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c60003c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651734.858057:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147483136 00000100:00100000:0.0:1788651734.858071:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147483136 00000100:00100000:1.0:1788651734.858386:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788651734.858399:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8420:x1875537147483136:12345-0@lo:101: 00010000:00010000:1.0:1788651734.858419:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651734.858439:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c39c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c39bc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.858467:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c39c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c39bc expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.858480:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c39c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c39bc expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.858489:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0031200, rc 0) 00000100:00100000:1.0:1788651734.858586:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:8420:x1875537147483136:12345-0@lo:101: Request processed in 190us (4746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.858593:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788651734.858676:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483136:0@lo:101: 00010000:00010000:2.0:1788651734.858696:0:8420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.858705:0:8420:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651734.858838:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483264:0@lo:501: 00000100:00100000:2.0:1788651734.858872:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651734.859197:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147483264 00000100:00100000:0.0:1788651734.859212:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147483264 00000100:00100000:0.0:1788651734.859241:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788651734.859247:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:8420:x1875537147483264:12345-0@lo:501: 00000100:00100000:0.0:1788651734.859338:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:8420:x1875537147483264:12345-0@lo:501: Request processed in 91us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651734.859345:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788651734.860033:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f09d1180 going to sleep for 11 seconds 00000100:00100000:3.0:1788651734.860053:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483264:0@lo:501: 00000100:00100000:3.0:1788651734.860088:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483392:0@lo:503: 00000100:00100000:3.0:1788651734.860134:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651734.860150:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d1349600 going to sleep for 11 seconds 00000100:00100000:0.0:1788651734.860263:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147483392 00000100:00100000:0.0:1788651734.860268:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147483392 00000100:00100000:0.0:1788651734.860292:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788651734.860298:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:8420:x1875537147483392:12345-0@lo:503: 00000100:00100000:0.0:1788651734.860373:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:8420:x1875537147483392:12345-0@lo:503: Request processed in 75us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651734.860379:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788651734.860751:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a37100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483392:0@lo:503: 00000040:00080000:0.0:1788651734.861009:0:8420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788651734.861071:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483520:0@lo:502: 00000100:00100000:0.0:1788651734.861106:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651734.861128:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147483520 00000100:00100000:0.0:1788651734.861132:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147483520 00000100:00100000:0.0:1788651734.861155:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788651734.861161:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:8420:x1875537147483520:12345-0@lo:502: 00000100:00100000:0.0:1788651734.861255:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:8420:x1875537147483520:12345-0@lo:502: Request processed in 93us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651734.861261:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788651734.861295:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651734.861306:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483520:0@lo:502: 00000040:00080000:0.0:1788651734.861482:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788651734.861506:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788651734.861519:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788651734.861532:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788651734.861543:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788651734.861557:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788651734.861570:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788651734.861584:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788651734.861596:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788651734.861609:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788651734.861622:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788651734.861635:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788651734.861646:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788651734.861659:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788651734.861673:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788651734.861686:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788651734.861699:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788651734.861714:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788651734.861726:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788651734.861739:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788651734.861751:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788651734.861776:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788651734.861791:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788651734.861805:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788651734.861829:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788651734.861842:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788651734.861855:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788651734.861872:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788651734.861882:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788651734.861893:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788651734.861927:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788651734.861944:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788651734.861955:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788651734.861968:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788651734.861981:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788651734.861993:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788651734.862005:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:0.0:1788651734.862037:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483648:0@lo:502: 00000100:00100000:0.0:1788651734.862076:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651734.862108:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147483648 00000100:00100000:0.0:1788651734.862114:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147483648 00000100:00100000:0.0:1788651734.862136:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788651734.862143:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:8420:x1875537147483648:12345-0@lo:502: 00000100:00100000:0.0:1788651734.862235:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:8420:x1875537147483648:12345-0@lo:502: Request processed in 92us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651734.862242:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788651734.862277:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651734.862290:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147483648:0@lo:502: 00000040:00080000:0.0:1788651734.862327:0:8420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788651734.862334:0:8420:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788651734.867137:0:8448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788651734.867171:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f85c20f8000) 00000020:00000080:1.0:1788651734.867195:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788651734.867292:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86eeab9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788651734.867296:0:8448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86eeab9800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788651734.867306:0:8448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86eeab9800 3 00010000:00080000:1.0:1788651734.867341:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c210e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.145@tcp at head 00010000:00010000:1.0:1788651734.871892:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1788651734.872734:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788651734.872779:0:8448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788651734.872792:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcd2f56ea038c39d1 00000100:00080000:1.0:1788651734.872804:0:8448:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788651734.872810:0:8448:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f85c210e800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788651734.872847:0:8448:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d4000 x1875537147483776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788651734.872934:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147483776:0@lo:38: 00000100:00100000:2.0:1788651734.873011:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788651734.874266:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788651734.874373:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147483904:0@lo:400: 00000100:00100000:1.0:1788651734.874416:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.874450:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651734.874455:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147484032:0@lo:400: 00000100:00100000:1.0:1788651734.874477:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651734.874710:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147484160:0@lo:400: 00000100:00100000:3.0:1788651734.874741:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651734.874765:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651734.874770:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147484288:0@lo:400: 00000100:00100000:3.0:1788651734.874789:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651734.874820:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147484032 00000100:00100000:3.0:1788651734.874828:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147484032 00000100:00100000:3.0:1788651734.874865:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147484288 00000100:00100000:3.0:1788651734.874869:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147484288 00000100:00100000:3.0:1788651734.874884:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651734.874891:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147484032:12345-0@lo:400: 00000100:00100000:3.0:1788651734.874973:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147484032:12345-0@lo:400: Request processed in 81us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651734.874980:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651734.874996:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788651734.875002:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147484288:12345-0@lo:400: 00000100:00100000:3.0:1788651734.875032:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147484288:12345-0@lo:400: Request processed in 30us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651734.875047:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788651734.875082:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147484032:0@lo:400: 00000100:00100000:3.0:1788651734.875106:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147484288:0@lo:400: 00000100:00100000:1.0:1788651734.875611:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147483776 00000100:00100000:1.0:1788651734.875616:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147483776 00000100:00100000:1.0:1788651734.875632:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147483904 00000100:00100000:1.0:1788651734.875635:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147483904 00000100:00100000:1.0:1788651734.875649:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147484160 00000100:00100000:1.0:1788651734.875652:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147484160 00000100:00100000:1.0:1788651734.875662:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651734.875667:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147483904:12345-0@lo:400: 00000100:00100000:1.0:1788651734.875722:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147483904:12345-0@lo:400: Request processed in 53us (1304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.875728:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651734.875740:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788651734.875755:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147484160:12345-0@lo:400: 00000100:00100000:1.0:1788651734.875787:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147484160:12345-0@lo:400: Request processed in 33us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.875793:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788651734.875804:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788651734.875808:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875537147483776:12345-0@lo:38: 00010000:00080000:1.0:1788651734.875829:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:1.0:1788651734.875876:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd2f56ea038c39d8 00000004:00100000:1.0:1788651734.875890:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788651734.876100:0:6511:0:(import.c:65:import_set_state_nolock()) ffff8f85c2108800 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1788651734.876186:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86f48d5c00 x1875537147483904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651734.876198:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147483904:0@lo:400: 00010000:00080000:3.0:1788651734.876237:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86f48d6680 x1875537147484160/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651734.876245:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147484160:0@lo:400: 00000020:01000004:0.0:1788651734.880826:0:8448:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788651734.880846:0:8448:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f86fcd73380) 00000020:00000080:0.0:1788651734.880873:0:8448:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:0.0:1788651734.880993:0:8448:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86eeab9800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788651734.880997:0:8448:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86eeab9800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788651734.881000:0:8448:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86eeab9800 3 00010000:00080000:0.0:1788651734.881197:0:8448:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c19f4000@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.145@tcp at head 00000100:00100000:1.0:1788651734.884648:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875537147483776:12345-0@lo:38: Request processed in 8828us (11627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.884661:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788651734.885685:0:8448:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:0.0:1788651734.886258:0:8448:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788651734.886303:0:8448:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788651734.886317:0:8448:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcd2f56ea038c39e6 00000100:00080000:0.0:1788651734.886326:0:8448:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788651734.886332:0:8448:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f85c19f4000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788651734.886365:0:8448:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86fb1c9180 x1875537147484416/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788651734.886379:0:8448:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00010000:00080000:2.0:1788651734.886669:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86f48d4000 x1875537147483776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788651744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651734.886680:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788651734.886690:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788651734.886698:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788651734.886702:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788651734.886705:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c210e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788651734.886712:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147483776:0@lo:38: 00000100:00100000:2.0:1788651734.886743:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875537147484416:0@lo:38: 00000100:00100000:2.0:1788651734.886802:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651734.888226:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147484416 00000100:00100000:0.0:1788651734.888238:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147484416 00000100:00100000:0.0:1788651734.888276:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788651734.888283:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875537147484416:12345-0@lo:38: 00010000:00080000:0.0:1788651734.888314:0:6510:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 190 last 0 00000020:00000080:0.0:1788651734.888354:0:6510:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcd2f56ea038c39ed 00000004:00100000:0.0:1788651734.888369:0:6510:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788651734.888401:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651734.888463:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875537147484416:12345-0@lo:38: Request processed in 179us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651734.888470:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:0.0:1788651734.888581:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788651734.888633:0:8420:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788651734.888661:0:8420:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788651734.888675:0:8420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651734.888695:0:8420:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788651734.888741:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788651734.888743:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788651734.888744:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651734.888746:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788651734.888747:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651734.888749:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651734.888750:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788651734.888751:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788651734.888753:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788651734.888754:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651734.888756:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788651734.888759:0:8420:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788651734.888761:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788651734.888763:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788651734.888764:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651734.888765:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788651734.888766:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651734.888766:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651734.888768:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788651734.888769:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788651734.888770:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788651734.888771:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651734.888772:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788651734.888804:0:8420:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788651734.888818:0:8420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147484544:0@lo:253: 00000100:00100000:0.0:1788651734.888855:0:8420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651734.888884:0:8420:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651734.889050:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147484544 00000100:00100000:0.0:1788651734.889055:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147484544 00000100:00100000:0.0:1788651734.889087:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788651734.889094:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:8420:x1875537147484544:12345-0@lo:253: 20000000:01000000:0.0:1788651734.889123:0:6502:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788651734.889135:0:6502:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788651734.889692:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86fb1c9180 x1875537147484416/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788651744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651734.889703:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788651734.889711:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788651734.889718:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788651734.889722:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788651734.889725:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f4000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788651734.889732:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875537147484416:0@lo:38: 20000000:01000000:0.0:1788651734.897725:0:6502:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788651734.897742:0:6502:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788651734.897839:0:6525:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788651734.897844:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788651734.897869:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.897888:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c38ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c38e3 expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.897945:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c29dd200/0xcd2f56ea038c3906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c38ff expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.897955:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.898000:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c29dd200/0xcd2f56ea038c3906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c38ff expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.898150:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86c29dd200/0xcd2f56ea038c3906 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c38ff expref: 16 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651734.898167:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147484672:0@lo:104: 00000100:00100000:1.0:1788651734.898247:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788651734.898304:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c38ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c38e3 expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.898312:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c38ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c38e3 expref: 16 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651734.898319:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147484800:0@lo:104: 00000100:00100000:1.0:1788651734.898337:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ca848a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651734.898394:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788651734.898412:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651734.898438:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147484672 00000100:00100000:2.0:1788651734.898446:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147484672 00000100:00100000:2.0:1788651734.898481:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147484800 00000100:00100000:2.0:1788651734.898484:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147484800 00000100:00100000:2.0:1788651734.898496:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788651734.898504:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f576dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6525:x1875537147484672:12345-0@lo:104: 00010000:00010000:2.0:1788651734.898526:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c38ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.898595:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788651734.898602:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f576dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6525:x1875537147484672:12345-0@lo:104: Request processed in 98us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651734.898610:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788651734.898645:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788651734.898652:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6525:x1875537147484800:12345-0@lo:104: 00010000:00010000:2.0:1788651734.898659:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c38e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.898689:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788651734.898694:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6525:x1875537147484800:12345-0@lo:104: Request processed in 44us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651734.898700:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788651734.898813:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788651734.898820:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c38ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.898827:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651734.898831:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c38ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.898840:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c38ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651734.898847:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c38ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651734.898853:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651734.898892:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c38ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.898899:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651734.898942:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c38ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.898949:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c38ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3906 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.898964:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651734.898967:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c38e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.898973:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651734.898975:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c38e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.898982:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c38e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651734.898988:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c38e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651734.898993:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651734.899208:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c38e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.899215:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651734.899222:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c38e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.899239:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c38e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c38ea expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.899255:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651734.899256:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651734.899258:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651734.899265:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651734.899286:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147484928:0@lo:103: 00000100:00100000:1.0:1788651734.899319:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651734.899385:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651734.899391:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147485056:0@lo:103: 00000100:00100000:1.0:1788651734.899410:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651734.899802:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:8420:x1875537147484544:12345-0@lo:253: Request processed in 10706us (10944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651734.899812:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788651734.899865:0:8420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8420:1875537147484544:0@lo:253: 10000000:01000000:0.0:1788651734.899877:0:8420:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788651734.899880:0:8420:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788651734.899881:0:8420:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788651734.899883:0:8420:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651734.899884:0:8420:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788651734.899886:0:8420:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651734.899887:0:8420:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651734.899889:0:8420:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788651734.899890:0:8420:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788651734.899903:0:8420:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788651734.899919:0:8420:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651734.899921:0:8420:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788651734.899938:0:8420:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1788651734.905429:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147484672:0@lo:104: 00000100:00100000:1.0:1788651734.905445:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147484800:0@lo:104: 00010000:00010000:1.0:1788651734.905471:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788651734.910819:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788651734.911467:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788651734.911751:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788651734.912060:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:2.0:1788651734.912117:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147484928 00000100:00100000:2.0:1788651734.912128:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147484928 00010000:00010000:2.0:1788651734.912169:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c29dd200/0xcd2f56ea038c3906 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c38ff expref: 16 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651734.912232:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147485056 00000100:00100000:2.0:1788651734.912236:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147485056 00000100:00100000:1.0:1788651734.912241:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788651734.912249:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c38ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c38e3 expref: 17 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651734.912251:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:3635:x1875537147484928:12345-0@lo:103: 00010000:00010000:1.0:1788651734.912267:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788651734.912270:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00010000:00010000:1.0:1788651734.912273:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c29dd200/0xcd2f56ea038c3906 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c38ff expref: 17 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651734.912275:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:3635:x1875537147485056:12345-0@lo:103: 00010000:00010000:2.0:1788651734.912281:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651734.912286:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c29dd200/0xcd2f56ea038c3906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c38ff expref: 17 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.912291:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c38ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c38e3 expref: 17 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.912308:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c38ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c38e3 expref: 17 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651734.912308:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c29dd200/0xcd2f56ea038c3906 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c38ff expref: 17 pid: 6505 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.912317:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c38ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c38e3 expref: 17 pid: 6502 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.912329:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.912338:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788651734.912583:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788651734.912843:0:8420:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 20000000:01000000:2.0:1788651734.915031:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017185986s 00010000:00010000:2.0:1788651734.915042:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.915054:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.915061:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.915067:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.915073:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788651734.915077:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.915084:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.915109:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.915115:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651734.915121:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651734.915123:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651734.915128:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c39f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651734.915218:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:3635:x1875537147485056:12345-0@lo:103: Request processed in 2939us (15803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651734.915228:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000001:00000004:0.0:1788651734.915506:0:8420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788651734.915677:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147485056:0@lo:103: 00010000:00010000:1.0:1788651734.915720:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651734.915786:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:3635:x1875537147484928:12345-0@lo:103: Request processed in 3535us (16464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651734.915793:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788651734.916152:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147484928:0@lo:103: 00002000:00080000:0.0:1788651734.928176:0:8420:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788651734.928185:0:8420:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788651734.928237:0:8420:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788651734.928279:0:8420:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788651734.928316:0:8420:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788651734.928352:0:8420:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1788651734.932186:0:8420:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788651734.932435:0:8420:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1788651735.520519:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788651736.120652:0:8504:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788651736.120873:0:8504:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788651736.547223:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651736.549039:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147485184:0@lo:41: 00000100:00100000:3.0:1788651736.549134:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651736.549404:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147485184 00000100:00100000:2.0:1788651736.549413:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147485184 00000100:00100000:2.0:1788651736.549477:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788651736.549487:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147485184:12345-0@lo:41: 00000004:00000024:2.0:1788651736.549524:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788651736.549582:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147485184:12345-0@lo:41: Request processed in 97us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651736.549588:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788651736.549745:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147485184:0@lo:41: 00010000:00010000:2.0:1788651737.568540:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651738.082211:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651738.082238:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147485312:0@lo:41: 00000100:00100000:1.0:1788651738.082308:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651738.082549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147485312 00000100:00100000:3.0:1788651738.082558:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147485312 00000100:00100000:3.0:1788651738.082610:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788651738.082619:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147485312:12345-0@lo:41: 00000004:00000024:3.0:1788651738.082654:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:3.0:1788651738.082713:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147485312:12345-0@lo:41: Request processed in 96us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651738.082721:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788651738.082929:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147485312:0@lo:41: 00010000:00010000:3.0:1788651738.601601:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651739.617811:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651740.129549:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147485440:0@lo:400: 00000100:00100000:3.0:1788651740.129622:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651740.129672:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147485952:0@lo:400: 00000100:00100000:3.0:1788651740.129697:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651740.129721:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788651740.129726:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147485568:0@lo:400: 00000100:00100000:3.0:1788651740.129749:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651740.129763:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147486080:0@lo:400: 00000100:00100000:3.0:1788651740.129784:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651740.129808:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147485824:0@lo:400: 00000100:00100000:3.0:1788651740.129829:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651740.129845:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788651740.129850:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147485696:0@lo:400: 00000100:00100000:3.0:1788651740.129869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651740.129884:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147486208:0@lo:400: 00000100:00100000:3.0:1788651740.129937:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651740.129974:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147485440 00000100:00100000:3.0:1788651740.129981:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147485440 00000100:00100000:3.0:1788651740.130021:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788651740.130029:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:3635:x1875537147485440:12345-0@lo:400: 00000100:00100000:3.0:1788651740.130078:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:3635:x1875537147485440:12345-0@lo:400: Request processed in 50us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651740.130086:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788651740.130136:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147485952 00000100:00100000:3.0:1788651740.130139:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147485952 00000100:00100000:3.0:1788651740.130161:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147485696 00000100:00100000:3.0:1788651740.130164:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147485696 00000100:00100000:3.0:1788651740.130176:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788651740.130182:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147485952:12345-0@lo:400: 00000100:00100000:3.0:1788651740.130215:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147485952:12345-0@lo:400: Request processed in 32us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651740.130221:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788651740.130233:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788651740.130238:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147485696:12345-0@lo:400: 00000100:00100000:3.0:1788651740.130269:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147485696:12345-0@lo:400: Request processed in 31us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651740.130275:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788651740.130292:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147485568 00000100:00100000:3.0:1788651740.130296:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147485568 00000100:00100000:3.0:1788651740.130314:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147486080 00000100:00100000:3.0:1788651740.130316:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147486080 00000100:00100000:3.0:1788651740.130335:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147485824 00000100:00100000:3.0:1788651740.130337:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147485824 00000100:00100000:3.0:1788651740.130359:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147486208 00000100:00100000:3.0:1788651740.130362:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147486208 00000100:00100000:3.0:1788651740.130376:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788651740.130382:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147485568:12345-0@lo:400: 00000100:00100000:3.0:1788651740.130411:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147485568:12345-0@lo:400: Request processed in 29us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651740.130417:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788651740.130428:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788651740.130434:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147486080:12345-0@lo:400: 00000100:00100000:3.0:1788651740.130459:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147486080:12345-0@lo:400: Request processed in 25us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651740.130464:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788651740.130474:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788651740.130479:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147485824:12345-0@lo:400: 00000100:00100000:3.0:1788651740.130503:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147485824:12345-0@lo:400: Request processed in 24us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651740.130508:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788651740.130519:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788651740.130524:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147486208:12345-0@lo:400: 00000100:00100000:3.0:1788651740.130548:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147486208:12345-0@lo:400: Request processed in 24us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651740.130554:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788651740.130593:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c1a37480 x1875537147485568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651740.130606:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147485568:0@lo:400: 00010000:00080000:3.0:1788651740.130616:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c1a35f80 x1875537147486080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651740.130630:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147486080:0@lo:400: 00000100:00100000:3.0:1788651740.130642:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147485440:0@lo:400: 00000100:00100000:3.0:1788651740.130652:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147485952:0@lo:400: 00000100:00100000:3.0:1788651740.130689:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147485696:0@lo:400: 00010000:00080000:3.0:1788651740.130698:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c1a35880 x1875537147486208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651740.130706:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147486208:0@lo:400: 00010000:00080000:3.0:1788651740.130714:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c1a37b80 x1875537147485824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651756 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651740.130721:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147485824:0@lo:400: 00000100:00080000:1.0:1788651740.132071:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788651740.132079:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1788651740.641391:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788651740.641399:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86f48d9800 from 30 10000000:01000000:2.0:1788651740.641404:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788651740.641461:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.641473:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.641485:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651740.641519:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147486336:0@lo:101: 00000100:00100000:2.0:1788651740.641628:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.641674:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0361600 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.641701:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147486336 00000100:00100000:2.0:1788651740.641717:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147486336 00000100:00100000:2.0:1788651740.641786:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788651740.641799:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:6507:x1875537147486336:12345-0@lo:101: 00010000:00010000:2.0:1788651740.641814:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651740.641835:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3a02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c39fb expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.641872:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c39fb expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.641892:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c39fb expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.641903:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9e00, rc 0) 00000100:00100000:2.0:1788651740.641989:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147486336:12345-0@lo:101: Request processed in 193us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.641995:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788651740.642050:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147486336:0@lo:101: 00010000:00010000:2.0:1788651740.642063:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.642071:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651740.642136:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147486464:0@lo:501: 00000100:00100000:2.0:1788651740.642170:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.642187:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0361600 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.642212:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147486464 00000100:00100000:2.0:1788651740.642217:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147486464 00000100:00100000:2.0:1788651740.642251:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788651740.642257:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147486464:12345-0@lo:501: 00000100:00100000:2.0:1788651740.642361:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147486464:12345-0@lo:501: Request processed in 104us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.642368:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788651740.642396:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147486464:0@lo:501: 00000100:00100000:2.0:1788651740.642436:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147486592:0@lo:503: 00000100:00100000:2.0:1788651740.642471:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.642483:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0361600 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.642493:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147486592 00000100:00100000:2.0:1788651740.642495:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147486592 00000100:00100000:2.0:1788651740.642513:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788651740.642518:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147486592:12345-0@lo:503: 00000100:00100000:2.0:1788651740.642583:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147486592:12345-0@lo:503: Request processed in 64us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.642588:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788651740.642619:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147486592:0@lo:503: 00000100:00100000:2.0:1788651740.642769:0:8733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8733:1875537147486720:0@lo:502: 00000100:00100000:2.0:1788651740.642800:0:8733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.642817:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147486720 00000100:00100000:2.0:1788651740.642820:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147486720 00000100:00100000:2.0:1788651740.642840:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788651740.642851:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8733:x1875537147486720:12345-0@lo:502: 00000100:00100000:2.0:1788651740.642948:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8733:x1875537147486720:12345-0@lo:502: Request processed in 96us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.642954:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788651740.642977:0:8733:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9300 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.642987:0:8733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8733:1875537147486720:0@lo:502: 00000100:00100000:2.0:1788651740.643018:0:8733:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8733:1875537147486848:0@lo:502: 00000100:00100000:2.0:1788651740.643042:0:8733:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.643057:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147486848 00000100:00100000:2.0:1788651740.643060:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147486848 00000100:00100000:2.0:1788651740.643075:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788651740.643080:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8733:x1875537147486848:12345-0@lo:502: 00000100:00100000:2.0:1788651740.643139:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:8733:x1875537147486848:12345-0@lo:502: Request processed in 58us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.643145:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788651740.643168:0:8733:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0900 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.643177:0:8733:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8733:1875537147486848:0@lo:502: 00000040:00080000:2.0:1788651740.643193:0:8733:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788651740.643245:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788651740.643261:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788651740.643273:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.643281:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651740.643289:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788651740.643296:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86f48d9800 from 5 10000000:01000000:2.0:1788651740.643299:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788651740.643319:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.643326:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.643333:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651740.643345:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147486976:0@lo:101: 00000100:00100000:2.0:1788651740.643369:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.643381:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0900 going to sleep for 11 seconds 00010000:00010000:2.0:1788651740.643393:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651740.643401:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147486976 00000100:00100000:2.0:1788651740.643404:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147486976 00000100:00100000:2.0:1788651740.643426:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788651740.643432:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147486976:12345-0@lo:101: 00010000:00010000:2.0:1788651740.643439:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651740.643451:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f8800/0xcd2f56ea038c3a10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3a09 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.643468:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f8800/0xcd2f56ea038c3a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a09 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.643477:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f8800/0xcd2f56ea038c3a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a09 expref: 16 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.643484:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f8800, rc 0) 00000100:00100000:2.0:1788651740.643511:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147486976:12345-0@lo:101: Request processed in 79us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.643522:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788651740.643551:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147486976:0@lo:101: 00010000:00010000:2.0:1788651740.643561:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.643568:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651740.643605:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147487104:0@lo:256: 00000100:00100000:2.0:1788651740.643631:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.643656:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0900 going to sleep for 11 seconds 00000100:00100000:0.0:1788651740.643664:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147487104 00000100:00100000:0.0:1788651740.643668:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147487104 00000100:00100000:0.0:1788651740.644111:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788651740.644120:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147487104:12345-0@lo:256: 20000000:01000000:0.0:1788651740.644134:0:6502:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788651740.644151:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788651740.644155:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788651740.644229:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147487104:12345-0@lo:256: Request processed in 111us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.644236:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788651740.645808:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147487104:0@lo:256: 10000000:01000000:2.0:1788651740.645866:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788651740.645875:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.645885:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651740.645893:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788651740.645896:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:2.0:1788651740.645899:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788651740.645946:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.645956:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.645976:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651740.645992:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147487232:0@lo:101: 00000100:00100000:2.0:1788651740.646038:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.646069:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0900 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.646084:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147487232 00000100:00100000:2.0:1788651740.646101:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147487232 00000100:00100000:2.0:1788651740.646138:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788651740.646146:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147487232:12345-0@lo:101: 00010000:00010000:2.0:1788651740.646157:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651740.646170:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c3a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3a17 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.646189:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c3a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a17 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.646212:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c3a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a17 expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.646221:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9200, rc 0) 00000100:00100000:2.0:1788651740.646591:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147487232:12345-0@lo:101: Request processed in 444us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.646693:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147487232:0@lo:101: 00010000:00010000:0.0:1788651740.646708:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.646716:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651740.646771:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147487360:0@lo:501: 00000100:00100000:0.0:1788651740.646799:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.646823:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651740.646877:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147487360 00000100:00100000:1.0:1788651740.646882:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147487360 00000100:00100000:1.0:1788651740.646935:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788651740.646944:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147487360:12345-0@lo:501: 00000100:00100000:1.0:1788651740.647059:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147487360:12345-0@lo:501: Request processed in 117us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651740.647067:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788651740.647112:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147487360:0@lo:501: 00000100:00100000:1.0:1788651740.647139:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147487488:0@lo:503: 00000100:00100000:1.0:1788651740.647182:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651740.647206:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651740.647218:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147487488 00000100:00100000:1.0:1788651740.647221:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147487488 00000100:00100000:1.0:1788651740.647439:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788651740.647454:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147487488:12345-0@lo:503: 00000100:00100000:1.0:1788651740.647531:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147487488:12345-0@lo:503: Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651740.647537:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788651740.647573:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147487488:0@lo:503: 00000100:00100000:2.0:1788651740.647796:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788651740.648121:0:8734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8734:1875537147487616:0@lo:502: 00000100:00100000:0.0:1788651740.648160:0:8734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.648192:0:8734:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef840 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.648360:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147487616 00000100:00100000:2.0:1788651740.648438:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147487616 00000100:00100000:2.0:1788651740.648479:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788651740.648486:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:8734:x1875537147487616:12345-0@lo:502: 00000100:00100000:2.0:1788651740.648580:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:8734:x1875537147487616:12345-0@lo:502: Request processed in 95us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.648587:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788651740.648699:0:8734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23afb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8734:1875537147487616:0@lo:502: 00000020:01000000:2.0:1788651740.648722:0:8734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788651740.648730:0:8734:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788651740.648737:0:8734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651740.648739:0:8734:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788651740.648743:0:8734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788651740.648747:0:8734:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:01000000:2.0:1788651740.648768:0:8734:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788651740.648770:0:8734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788651740.648785:0:8734:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f86fb24b380) 00000020:00000080:2.0:1788651740.648804:0:8734:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:2.0:1788651740.648809:0:8734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788651740.648901:0:8734:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788651740.648930:0:8734:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788651740.648938:0:8734:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c3a2c 00010000:00080000:2.0:1788651740.648966:0:8734:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c1a54800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788651740.649683:0:8734:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788651740.665389:0:8734:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788651740.665423:0:8734:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788651740.665675:0:8734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788651740.666143:0:8734:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788651740.666254:0:8734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788651740.666471:0:8734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788651740.667269:0:8735:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651740.667274:0:8735:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788651740.673850:0:8734:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788651740.673883:0:8734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788651740.674155:0:8734:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788651740.674184:0:8734:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c3a33 00000100:00080000:0.0:1788651740.674205:0:8734:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788651740.674213:0:8734:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f85c1a54800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788651740.678152:0:8734:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c23ac380 x1875537147487744/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788651740.678203:0:8734:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788651740.678332:0:8734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651740.678340:0:8734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651740.678342:0:8734:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788651740.678345:0:8734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651740.678350:0:8734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651740.678352:0:8734:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788651740.678354:0:8734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788651740.678357:0:8734:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788651740.678413:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147487744:0@lo:8: 00000100:00100000:1.0:1788651740.678493:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.678552:0:8734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8734:1875537147487872:0@lo:502: 00000100:00100000:0.0:1788651740.678815:0:8734:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.678847:0:8734:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6262840 going to sleep for 11 seconds 00000100:00100000:1.0:1788651740.678863:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147487872 00000100:00100000:1.0:1788651740.678871:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147487872 00000100:00100000:1.0:1788651740.678943:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788651740.678951:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:8734:x1875537147487872:12345-0@lo:502: 00000100:00100000:2.0:1788651740.679033:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147487744 00000100:00100000:2.0:1788651740.679039:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147487744 00000100:00100000:2.0:1788651740.679064:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788651740.679071:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875537147487744:12345-0@lo:8: 00000100:00100000:1.0:1788651740.679078:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:8734:x1875537147487872:12345-0@lo:502: Request processed in 126us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651740.679097:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00080000:2.0:1788651740.679108:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:2.0:1788651740.679141:0:8427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c3a3a 00002000:00100000:2.0:1788651740.679188:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f85c1a51000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00000100:00100000:0.0:1788651740.679208:0:8734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8734:1875537147487872:0@lo:502: 00000020:01000000:0.0:1788651740.679234:0:8734:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651740.679239:0:8734:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651740.679241:0:8734:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788651740.679245:0:8734:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00002000:00080000:2.0:1788651740.679313:0:8427:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:2.0:1788651740.679317:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:1.0:1788651740.679396:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:1.0:1788651740.679429:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788651740.679439:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:2.0:1788651740.679447:0:8427:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00010000:00010000:1.0:1788651740.679450:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651740.679461:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788651740.679464:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86da667000 from 30 10000000:01000000:1.0:1788651740.679467:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788651740.679500:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651740.679508:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651740.679517:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651740.679531:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147488000:0@lo:101: 00000100:00100000:1.0:1788651740.679682:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651740.679712:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86da748e40 going to sleep for 11 seconds 00002000:00080000:2.0:1788651740.679870:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788651740.679894:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8f85c1a55800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788651740.679963:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3634:x1875537147487744:12345-0@lo:8: Request processed in 891us (1470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.679971:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788651740.680388:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147488000 00000100:00100000:0.0:1788651740.680412:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147488000 00000100:00100000:0.0:1788651740.680457:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788651740.680467:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147488000:12345-0@lo:101: 00010000:00010000:0.0:1788651740.680478:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651740.680496:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3a48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3a41 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.680525:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a41 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.680549:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a41 expref: 18 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.680559:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5600, rc 0) 00000100:00100000:0.0:1788651740.680604:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147488000:12345-0@lo:101: Request processed in 139us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.680610:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788651740.680642:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147488000:0@lo:101: 00010000:00010000:2.0:1788651740.680668:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.680823:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:1.0:1788651740.680883:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23ac380 x1875537147487744/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788651750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651740.680891:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147488128:0@lo:501: 00000100:00100000:1.0:1788651740.680895:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788651740.680903:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788651740.680941:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788651740.680947:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788651740.680952:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c1a54800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788651740.680953:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788651740.680972:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788651740.680980:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147487744:0@lo:8: 00000100:00100000:2.0:1788651740.680989:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0480 going to sleep for 11 seconds 00000004:00080000:1.0:1788651740.681007:0:8735:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788651740.681069:0:8735:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 196616160134ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788651740.681075:0:8735:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788651740.682693:0:8736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8736:1875537147488256:0@lo:700: 00000100:00100000:0.0:1788651740.682747:0:8736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.682774:0:8736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651740.682800:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147488128 00000100:00100000:0.0:1788651740.682807:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147488128 00000100:00100000:0.0:1788651740.682847:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788651740.682854:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147488128:12345-0@lo:501: 00000100:00100000:0.0:1788651740.683002:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147488128:12345-0@lo:501: Request processed in 147us (2050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.683014:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788651740.683081:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147488128:0@lo:501: 00000100:00100000:0.0:1788651740.683140:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147488384:0@lo:503: 00000100:00100000:0.0:1788651740.683183:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.683206:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651740.683218:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147488384 00000100:00100000:0.0:1788651740.683222:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147488384 00000100:00100000:0.0:1788651740.683243:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788651740.683249:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147488384:12345-0@lo:503: 00000100:00100000:0.0:1788651740.683320:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147488384:12345-0@lo:503: Request processed in 71us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.683328:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788651740.683365:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147488384:0@lo:503: 00000100:00100000:1.0:1788651740.685493:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147488256 00000100:00100000:1.0:1788651740.685507:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147488256 00000100:00100000:1.0:1788651740.685574:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651740.685582:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8736:x1875537147488256:12345-0@lo:700: 00000100:00100000:1.0:1788651740.685629:0:8435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1875537147488640:0@lo:700: 00000100:00100000:1.0:1788651740.685689:0:8435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651740.685717:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147488640 00000100:00100000:1.0:1788651740.685719:0:8435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86da748180 going to sleep for 11 seconds 00000100:00100000:3.0:1788651740.685721:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147488640 00000100:00080000:1.0:1788651740.685733:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651740.685751:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651740.685757:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1875537147488640:12345-0@lo:700: 00000100:00100000:0.0:1788651740.685974:0:8739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8739:1875537147488512:0@lo:502: 00000100:00100000:0.0:1788651740.686022:0:8739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.686053:0:8739:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651740.686666:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147488512 00000100:00100000:1.0:1788651740.686674:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147488512 00000100:00100000:1.0:1788651740.686711:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788651740.686718:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:8739:x1875537147488512:12345-0@lo:502: 00000100:00100000:1.0:1788651740.686852:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:8739:x1875537147488512:12345-0@lo:502: Request processed in 134us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651740.686860:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000004:00080000:0.0:1788651740.687215:0:7440:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788651740.687262:0:8739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8739:1875537147488512:0@lo:502: 00000100:00100000:0.0:1788651740.687329:0:8739:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8739:1875537147488768:0@lo:502: 00000100:00100000:0.0:1788651740.687366:0:8739:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.687391:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147488768 00000100:00100000:0.0:1788651740.687395:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147488768 00000100:00100000:0.0:1788651740.687419:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788651740.687425:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:8739:x1875537147488768:12345-0@lo:502: 00000100:00100000:0.0:1788651740.687494:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:8739:x1875537147488768:12345-0@lo:502: Request processed in 68us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.687500:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788651740.690129:0:8739:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651740.690177:0:8739:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8739:1875537147488768:0@lo:502: 00000040:00080000:0.0:1788651740.690222:0:8739:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788651740.690738:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788651740.690762:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788651740.690773:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651740.690784:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651740.690794:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788651740.690796:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86da667000 from 5 10000000:01000000:1.0:1788651740.690799:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788651740.690840:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651740.690849:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651740.690858:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651740.690888:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147488896:0@lo:101: 00000100:00100000:1.0:1788651740.690973:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651740.691012:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86da748e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788651740.691205:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147488896 00000100:00100000:0.0:1788651740.691212:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147488896 00000100:00100000:0.0:1788651740.691252:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788651740.691261:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147488896:12345-0@lo:101: 00010000:00010000:0.0:1788651740.691272:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651740.691285:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c3a56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3a4f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.691308:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c3a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a4f expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.691319:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c3a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a4f expref: 19 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.691328:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4800, rc 0) 00000100:00100000:0.0:1788651740.691366:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147488896:12345-0@lo:101: Request processed in 107us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.691373:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788651740.691407:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147488896:0@lo:101: 00010000:00010000:0.0:1788651740.691420:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.691429:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651740.691469:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147489024:0@lo:256: 00000100:00100000:0.0:1788651740.691520:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.691550:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788651740.691563:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147489024 00000100:00100000:0.0:1788651740.691566:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147489024 00000100:00100000:0.0:1788651740.691588:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788651740.691593:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147489024:12345-0@lo:256: 20000000:01000000:0.0:1788651740.691605:0:6502:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788651740.691619:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788651740.691621:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788651740.691684:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147489024:12345-0@lo:256: Request processed in 90us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.691691:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788651740.691719:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147489024:0@lo:256: 10000000:01000000:0.0:1788651740.691754:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788651740.691760:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.691769:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651740.691776:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788651740.691778:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788651740.691780:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788651740.691794:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.691801:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.691817:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651740.691827:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147489152:0@lo:101: 00000100:00100000:0.0:1788651740.691849:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.691870:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788651740.691996:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147489152 00000100:00100000:1.0:1788651740.692002:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147489152 00000100:00100000:1.0:1788651740.692037:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788651740.692044:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147489152:12345-0@lo:101: 00010000:00010000:1.0:1788651740.692051:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651740.692060:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3a64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3a5d expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651740.692181:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a5d expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651740.692189:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a5d expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651740.692196:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0030400, rc 0) 00000100:00100000:1.0:1788651740.692227:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147489152:12345-0@lo:101: Request processed in 183us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651740.692233:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788651740.692268:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147489152:0@lo:101: 00010000:00010000:0.0:1788651740.692278:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651740.692286:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651740.692334:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147489280:0@lo:501: 00000100:00100000:0.0:1788651740.692359:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.692379:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.694060:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147489280 00000100:00100000:2.0:1788651740.694077:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147489280 00000100:00100000:2.0:1788651740.694132:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788651740.694141:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147489280:12345-0@lo:501: 00000100:00100000:2.0:1788651740.694306:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147489280:12345-0@lo:501: Request processed in 166us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.694314:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 40000000:02000000:0.0:1788651740.694789:0:6516:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:1.0:1788651740.695042:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147489280:0@lo:501: 00000100:00100000:1.0:1788651740.695116:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147489408:0@lo:503: 00000100:00100000:1.0:1788651740.695176:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651740.695216:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c39049c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.695942:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147489408 00000100:00100000:2.0:1788651740.695949:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147489408 00000100:00100000:2.0:1788651740.695999:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788651740.696006:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147489408:12345-0@lo:503: 00000100:00100000:2.0:1788651740.696122:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147489408:12345-0@lo:503: Request processed in 115us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.696129:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788651740.696177:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147489408:0@lo:503: 00000100:00100000:2.0:1788651740.696839:0:8740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8740:1875537147489536:0@lo:502: 00000100:00100000:2.0:1788651740.696956:0:8740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.696985:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147489536 00000100:00100000:2.0:1788651740.696989:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147489536 00000100:00100000:2.0:1788651740.697019:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788651740.697026:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:8740:x1875537147489536:12345-0@lo:502: 00000100:00100000:2.0:1788651740.697130:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:8740:x1875537147489536:12345-0@lo:502: Request processed in 105us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.697138:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788651740.697185:0:8740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0361600 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.697214:0:8740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8740:1875537147489536:0@lo:502: 00000020:01000000:2.0:1788651740.697957:0:8740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788651740.697965:0:8740:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788651740.697972:0:8740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651740.697975:0:8740:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788651740.697981:0:8740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788651740.697985:0:8740:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:01000000:2.0:1788651740.698018:0:8740:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788651740.698022:0:8740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788651740.698042:0:8740:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f85c2930000) 00000020:00000080:2.0:1788651740.698065:0:8740:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788651740.698077:0:8740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788651740.698174:0:8740:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788651740.698180:0:8740:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788651740.698187:0:8740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c3a72 00010000:00080000:2.0:1788651740.698221:0:8740:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c2925800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788651740.699781:0:8740:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:2.0:1788651740.710440:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8435:x1875537147488640:12345-0@lo:700: Request processed in 24671us (24740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.710460:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788651740.712004:0:8435:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f48d4700 x1875537147488640/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788651756 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651740.712022:0:8435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8435:1875537147488640:0@lo:700: 40000000:02000000:0.0:1788651740.712037:0:8435:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:2.0:1788651740.716349:0:8740:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788651740.716393:0:8740:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788651740.716767:0:8740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651740.717017:0:8740:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651740.717124:0:8740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788651740.717212:0:8740:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000001:00100000:2.0:1788651740.727718:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788651740.727898:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8736:x1875537147488256:12345-0@lo:700: Request processed in 42312us (45146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.727930:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:0.0:1788651740.728079:0:8741:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788651740.728099:0:8741:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00010000:00080000:2.0:1788651740.728381:0:8736:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23adf80 x1875537147488256/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788651756 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651740.728395:0:8736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8736:1875537147488256:0@lo:700: 00000020:00000080:2.0:1788651740.730881:0:8740:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788651740.730898:0:8740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788651740.731056:0:8740:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788651740.731081:0:8740:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c3a79 00000100:00080000:2.0:1788651740.731102:0:8740:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788651740.731108:0:8740:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f85c2925800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788651740.731144:0:8740:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d1c00 x1875537147489664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788651740.731220:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147489664:0@lo:8: 00000100:00100000:1.0:1788651740.731427:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788651740.731575:0:8740:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788651740.731639:0:8740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651740.731650:0:8740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651740.731652:0:8740:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788651740.731655:0:8740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651740.731659:0:8740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651740.731660:0:8740:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788651740.731663:0:8740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788651740.731665:0:8740:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788651740.731690:0:8740:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8740:1875537147489792:0@lo:502: 00000100:00100000:2.0:1788651740.731731:0:8740:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.731750:0:8740:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f09d1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.731770:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147489792 00000100:00100000:2.0:1788651740.731775:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147489792 00000100:00100000:2.0:1788651740.731814:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788651740.731822:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:8740:x1875537147489792:12345-0@lo:502: 00000100:00100000:2.0:1788651740.731943:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:8740:x1875537147489792:12345-0@lo:502: Request processed in 122us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.731951:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788651740.732004:0:8740:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:8740:1875537147489792:0@lo:502: 00000020:01000000:2.0:1788651740.732030:0:8740:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651740.732034:0:8740:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651740.732035:0:8740:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788651740.732039:0:8740:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1788651740.732154:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788651740.732176:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788651740.732185:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.732207:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651740.732501:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788651740.732504:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f86da6c3380 from 1 10000000:01000000:2.0:1788651740.732508:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788651740.732532:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.732540:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.732549:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651740.732563:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147489920:0@lo:101: 00000100:00100000:2.0:1788651740.732605:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.732624:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f09d1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.732638:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147489920 00000100:00100000:2.0:1788651740.732642:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147489920 00000100:00100000:2.0:1788651740.732671:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788651740.732678:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147489920:12345-0@lo:101: 00010000:00010000:2.0:1788651740.732687:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651740.732712:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3a87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3a80 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.732734:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a80 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.732745:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a80 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.732764:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dcc00, rc 0) 00000100:00100000:2.0:1788651740.732794:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147489920:12345-0@lo:101: Request processed in 117us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.732801:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788651740.732830:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147489920:0@lo:101: 00010000:00010000:2.0:1788651740.732841:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.732849:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651740.732889:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147490048:0@lo:501: 00000100:00100000:2.0:1788651740.732935:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.732954:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f09d1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788651740.732965:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147490048 00000100:00100000:2.0:1788651740.732968:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147490048 00000100:00100000:2.0:1788651740.732991:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788651740.732996:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147490048:12345-0@lo:501: 00000100:00100000:2.0:1788651740.733057:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147490048:12345-0@lo:501: Request processed in 60us (122us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788651740.733064:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788651740.733103:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147490048:0@lo:501: 10000000:01000000:2.0:1788651740.733122:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788651740.733127:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651740.733144:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651740.733398:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147489664 00000100:00100000:0.0:1788651740.733508:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147489664 00000100:00100000:0.0:1788651740.733535:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788651740.733541:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875537147489664:12345-0@lo:8: 00010000:00080000:0.0:1788651740.733563:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:0.0:1788651740.733599:0:8429:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c3a8e 00002000:00100000:0.0:1788651740.733614:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f85c19f0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788651740.733618:0:8429:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788651740.733621:0:8429:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788651740.733702:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788651740.733725:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651740.733880:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875537147489664:12345-0@lo:8: Request processed in 337us (2453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.733887:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788651740.734191:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f48d1c00 x1875537147489664/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788651750 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788651740.735790:0:8736:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788651740.735819:0:8736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8736:1875537147490304:0@lo:7: 00000100:00100000:0.0:1788651740.735872:0:8736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.735927:0:8736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651740.735947:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147490304 00000100:00100000:0.0:1788651740.735953:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147490304 00000100:00100000:0.0:1788651740.735994:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788651740.736003:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8736:x1875537147490304:12345-0@lo:7: 00000100:00100000:1.0:1788651740.736987:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788651740.736997:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788651740.737007:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788651740.737047:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788651740.737050:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c2925800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788651740.737125:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788651740.737133:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147489664:0@lo:8: 00002000:00080000:0.0:1788651740.742215:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788651740.742224:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788651740.742308:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8736:x1875537147490304:12345-0@lo:7: Request processed in 6303us (6432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.742326:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788651740.742377:0:8736:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23aed80 x1875537147490304/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788651756 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651740.742392:0:8736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8736:1875537147490304:0@lo:7: 00000004:00080000:0.0:1788651740.742538:0:8736:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788651740.742575:0:8736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8736:1875537147490432:0@lo:5: 00000100:00100000:0.0:1788651740.742672:0:8736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.742694:0:8736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b86c0 going to sleep for 11 seconds 00000004:00080000:0.0:1788651740.742711:0:8741:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788651740.745082:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147490176:0@lo:13: 00000004:00080000:2.0:1788651740.745126:0:8742:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788651740.745146:0:8742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8742:1875537147490688:0@lo:7: 00000100:00100000:3.0:1788651740.745172:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.745176:0:8742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651740.745335:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651740.745348:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147490560:0@lo:13: 00000004:00080000:0.0:1788651740.745697:0:8741:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 196680788463ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788651740.745704:0:8741:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1788651740.745742:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147490432 00000100:00100000:0.0:1788651740.745749:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147490432 00000100:00100000:0.0:1788651740.745783:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147490688 00000100:00100000:0.0:1788651740.745786:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147490688 00000100:00100000:0.0:1788651740.745813:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788651740.745821:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8736:x1875537147490432:12345-0@lo:5: 00002000:00080000:0.0:1788651740.745848:0:8428:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788651740.748497:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788651740.748541:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788651740.749929:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788651740.750032:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147490176 00000100:00100000:2.0:1788651740.750042:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147490176 00000100:00100000:2.0:1788651740.750160:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147490560 00000100:00100000:2.0:1788651740.750164:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147490560 00000100:00100000:2.0:1788651740.750183:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788651740.750193:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875537147490176:12345-0@lo:13: 00002000:00000024:2.0:1788651740.750343:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1788651740.750526:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3638:x1875537147490176:12345-0@lo:13: Request processed in 333us (5353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.750532:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788651740.750548:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788651740.750554:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147490560:12345-0@lo:13: 00002000:00000024:2.0:1788651740.750563:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923808256 avail 3692285952 00000100:00100000:2.0:1788651740.750659:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147490560:12345-0@lo:13: Request processed in 106us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651740.750665:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788651740.750698:0:8742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f09d1240 going to sleep for 11 seconds 00010000:00080000:1.0:1788651740.750764:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f48d2d80 x1875537147490560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651740.750783:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147490560:0@lo:13: 00000100:00100000:0.0:1788651740.750937:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8736:x1875537147490432:12345-0@lo:5: Request processed in 5115us (8263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.750946:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788651740.750964:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788651740.750972:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8742:x1875537147490688:12345-0@lo:7: 00010000:00080000:2.0:1788651740.751330:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23ace00 x1875537147490176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651740.751346:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147490176:0@lo:13: 00010000:00080000:1.0:1788651740.753821:0:8736:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23aed80 x1875537147490432/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651756 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651740.753839:0:8736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8736:1875537147490432:0@lo:5: 00000004:00080000:1.0:1788651740.753853:0:8736:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788651740.753892:0:8736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8736:1875537147490816:0@lo:5: 00000100:00100000:1.0:1788651740.755476:0:8736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651740.755528:0:8736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3904cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651740.755561:0:8429:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788651740.755568:0:8429:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788651740.757056:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147490816 00000100:00100000:3.0:1788651740.757069:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147490816 00000100:00100000:3.0:1788651740.757404:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788651740.757414:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:8736:x1875537147490816:12345-0@lo:5: 00002000:00080000:3.0:1788651740.757458:0:8744:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788651740.761464:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:8736:x1875537147490816:12345-0@lo:5: Request processed in 4044us (7057us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788651740.761482:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788651740.761547:0:8736:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f48d7100 x1875537147490816/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651756 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651740.761563:0:8736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8736:1875537147490816:0@lo:5: 00000004:00080000:3.0:1788651740.761578:0:8736:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788651740.761620:0:8736:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a35880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8736:1875537147490944:0@lo:900: 00000100:00100000:3.0:1788651740.761656:0:8736:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651740.761681:0:8736:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651740.761700:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147490944 00000100:00100000:3.0:1788651740.761706:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147490944 00000100:00100000:3.0:1788651740.761741:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788651740.761749:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8736:x1875537147490944:12345-0@lo:900: 00000100:00100000:3.0:1788651740.761791:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8736:x1875537147490944:12345-0@lo:900: Request processed in 42us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651740.761797:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788651740.761823:0:8736:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c1a35880 x1875537147490944/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788651756 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651740.761833:0:8736:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a35880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8736:1875537147490944:0@lo:900: 00002000:00080000:0.0:1788651740.764490:0:8428:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788651740.764499:0:8428:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788651740.764693:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8742:x1875537147490688:12345-0@lo:7: Request processed in 13718us (19510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.764713:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788651740.764786:0:8742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f48d0e00 x1875537147490688/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788651756 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651740.764799:0:8742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8742:1875537147490688:0@lo:7: 00000004:00080000:2.0:1788651740.764811:0:8742:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788651740.764846:0:8742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8742:1875537147491072:0@lo:5: 00000100:00100000:2.0:1788651740.764878:0:8742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651740.765020:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147491072 00000100:00100000:1.0:1788651740.765027:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147491072 00000100:00100000:1.0:1788651740.765168:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788651740.765177:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8742:x1875537147491072:12345-0@lo:5: 00000100:00100000:2.0:1788651740.765348:0:8742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f09d1240 going to sleep for 11 seconds 00002000:00080000:1.0:1788651740.765491:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788651740.765496:0:8429:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:2.0:1788651740.770145:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:2.0:1788651740.770166:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1788651740.770175:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788651740.770673:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8742:x1875537147491072:12345-0@lo:5: Request processed in 5492us (5789us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788651740.770684:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788651740.770741:0:8742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f48d0e00 x1875537147491072/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651756 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651740.770752:0:8742:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788651740.770758:0:8742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8742:1875537147491072:0@lo:5: 00000004:00080000:2.0:1788651740.770773:0:8742:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788651740.770823:0:8742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8742:1875537147491200:0@lo:700: 00000100:00100000:2.0:1788651740.770856:0:8742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651740.770899:0:8742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f09d1240 going to sleep for 11 seconds 00000100:00100000:0.0:1788651740.771044:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147491200 00000100:00100000:0.0:1788651740.771052:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147491200 00000100:00100000:0.0:1788651740.771115:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788651740.771125:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8742:x1875537147491200:12345-0@lo:700: 00000100:00100000:0.0:1788651740.788040:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8742:x1875537147491200:12345-0@lo:700: Request processed in 16908us (17174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651740.788054:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788651740.788140:0:8742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f48d0e00 x1875537147491200/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788651756 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651740.788153:0:8742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8742:1875537147491200:0@lo:700: 00000004:02000040:0.0:1788651740.790007:0:8742:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:0.0:1788651740.795721:0:8742:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8742:1875537147491328:0@lo:5: 00000100:00100000:0.0:1788651740.795790:0:8742:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651740.795959:0:8742:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2d329c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651740.798862:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147491328 00000100:00100000:1.0:1788651740.798876:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147491328 00000100:00100000:1.0:1788651740.798954:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788651740.798965:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8742:x1875537147491328:12345-0@lo:5: 00002000:00080000:1.0:1788651740.804047:0:8744:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788651740.804195:0:8744:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:1.0:1788651740.806039:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8742:x1875537147491328:12345-0@lo:5: Request processed in 7070us (10241us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788651740.806051:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788651740.806276:0:8742:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23af100 x1875537147491328/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651756 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651740.806292:0:8742:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23af100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8742:1875537147491328:0@lo:5: 00000004:00080000:2.0:1788651740.806318:0:8742:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1788651741.664185:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651741.667259:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147491456:0@lo:41: 00000100:00100000:0.0:1788651741.667341:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651741.673818:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147491456 00000100:00100000:1.0:1788651741.673835:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147491456 00000100:00100000:1.0:1788651741.673896:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788651741.673927:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147491456:12345-0@lo:41: 00000004:00000024:1.0:1788651741.673966:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788651741.677300:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147491456:12345-0@lo:41: Request processed in 3382us (9946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651741.677314:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788651741.687077:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147491456:0@lo:41: 00000001:02000400:3.0:1788651741.764788:0:8803:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788651742.689036:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788651742.852671:0:8855:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788651742.852863:0:8855:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788651743.200219:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651743.200249:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147491584:0@lo:41: 00000100:00100000:2.0:1788651743.200341:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651743.200520:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147491584 00000100:00100000:3.0:1788651743.200528:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147491584 00000100:00100000:3.0:1788651743.200573:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788651743.200583:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147491584:12345-0@lo:41: 00000004:00000024:3.0:1788651743.200632:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:3.0:1788651743.200684:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147491584:12345-0@lo:41: Request processed in 102us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651743.200692:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788651743.200775:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147491584:0@lo:41: 00010000:00010000:2.0:1788651743.712521:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788651743.857230:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1788651744.736895:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651745.760134:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147492096:0@lo:400: 00000100:00100000:3.0:1788651745.760176:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147491968:0@lo:400: 00000100:00100000:0.0:1788651745.760199:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651745.760206:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651745.760310:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147491712:0@lo:400: 00000100:00100000:1.0:1788651745.760345:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651745.760368:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147492224:0@lo:400: 00000100:00100000:0.0:1788651745.760380:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147492608:0@lo:400: 00000100:00100000:1.0:1788651745.760405:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651745.760405:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651745.760423:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147492736:0@lo:400: 00000100:00100000:1.0:1788651745.760443:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651745.760451:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651745.760464:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147492096 00000100:00100000:1.0:1788651745.760466:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147491968 00000100:00100000:1.0:1788651745.760473:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147491968 00000100:00100000:0.0:1788651745.760473:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147492096 00000100:00100000:1.0:1788651745.760509:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147492224 00000100:00100000:1.0:1788651745.760512:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147492224 00000100:00100000:0.0:1788651745.760513:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788651745.760520:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147492096:12345-0@lo:400: 00000100:00100000:1.0:1788651745.760524:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788651745.760529:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147491968:12345-0@lo:400: 00000100:00100000:1.0:1788651745.760564:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147491968:12345-0@lo:400: Request processed in 33us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651745.760571:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788651745.760587:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788651745.760593:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147492224:12345-0@lo:400: 00000100:00100000:1.0:1788651745.760625:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147492224:12345-0@lo:400: Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651745.760631:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788651745.760682:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147492224:0@lo:400: 00000100:00100000:0.0:1788651745.761545:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147492096:12345-0@lo:400: Request processed in 1019us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651745.761738:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788651745.761774:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147492608 00000100:00100000:0.0:1788651745.761780:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147492608 00000100:00100000:0.0:1788651745.762183:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147492736 00000100:00100000:0.0:1788651745.762188:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147492736 00000100:00100000:0.0:1788651745.762211:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788651745.762218:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147492608:12345-0@lo:400: 00000100:00100000:0.0:1788651745.762273:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147492608:12345-0@lo:400: Request processed in 55us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651745.762279:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788651745.762496:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788651745.762505:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147492736:12345-0@lo:400: 00000100:00100000:1.0:1788651745.762546:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147492736:12345-0@lo:400: Request processed in 43us (2102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651745.762553:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788651745.762593:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23aea00 x1875537147492736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651745.762605:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788651745.762628:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147492736:0@lo:400: 00010000:00080000:1.0:1788651745.762689:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23ae300 x1875537147492096/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651745.762700:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147492096:0@lo:400: 00010000:00080000:1.0:1788651745.762712:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23adf80 x1875537147492608/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651745.762719:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788651745.762727:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147492608:0@lo:400: 00000100:00080000:1.0:1788651745.762758:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651745.763216:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147492480:0@lo:400: 00000100:00100000:3.0:1788651745.763270:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651745.763319:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147491968:0@lo:400: 00000100:00100000:3.0:1788651745.763332:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788651745.763341:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147491840:0@lo:400: 00000100:00100000:3.0:1788651745.763364:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651745.763380:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147492480 00000100:00100000:3.0:1788651745.763381:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147492352:0@lo:400: 00000100:00100000:0.0:1788651745.763385:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147492480 00000100:00100000:3.0:1788651745.763399:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651745.763416:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147491840 00000100:00100000:0.0:1788651745.763419:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147491840 00000100:00100000:3.0:1788651745.763442:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147492352 00000100:00100000:3.0:1788651745.763446:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147492352 00000100:00100000:3.0:1788651745.763469:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788651745.763475:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147492480:12345-0@lo:400: 00000100:00100000:3.0:1788651745.763516:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147492480:12345-0@lo:400: Request processed in 41us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651745.763524:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788651745.763538:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788651745.763544:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147492352:12345-0@lo:400: 00000100:00100000:3.0:1788651745.763569:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147492352:12345-0@lo:400: Request processed in 26us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651745.763582:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1788651745.763612:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23aed80 x1875537147492352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651745.763621:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147492352:0@lo:400: 00010000:00080000:3.0:1788651745.763631:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23ace00 x1875537147492480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651745.763639:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147492480:0@lo:400: 00000100:00100000:2.0:1788651745.763878:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147491712 00000100:00100000:2.0:1788651745.763883:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147491712 00000100:00100000:2.0:1788651745.763943:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788651745.763950:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3638:x1875537147491712:12345-0@lo:400: 00000100:00100000:2.0:1788651745.764005:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3638:x1875537147491712:12345-0@lo:400: Request processed in 56us (3659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651745.764011:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788651745.764048:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147492864:0@lo:13: 00000100:00100000:2.0:1788651745.764078:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651745.764119:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147491712:0@lo:400: 00000100:00100000:2.0:1788651745.764138:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147492864 00000100:00100000:2.0:1788651745.764142:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147492864 00000100:00100000:2.0:1788651745.764166:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788651745.764172:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147492864:12345-0@lo:13: 00002000:00000024:2.0:1788651745.764194:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651745.764231:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147492864:12345-0@lo:13: Request processed in 59us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651745.764238:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788651745.764276:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f48d0e00 x1875537147492864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651745.764291:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147492864:0@lo:13: 00000100:00100000:0.0:1788651745.764566:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788651745.764588:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147491840:12345-0@lo:400: 00000100:00100000:0.0:1788651745.764624:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147491840:12345-0@lo:400: Request processed in 51us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651745.764630:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788651745.765576:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651745.765591:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147492992:0@lo:13: 00000100:00100000:2.0:1788651745.765655:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651745.765695:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147492992 00000100:00100000:2.0:1788651745.765701:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147492992 00000100:00100000:2.0:1788651745.765733:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788651745.765740:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147492992:12345-0@lo:13: 00002000:00000024:2.0:1788651745.765757:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651745.765792:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147492992:12345-0@lo:13: Request processed in 53us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651745.765799:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788651745.765830:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f48d0e00 x1875537147492992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651745.765845:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147492992:0@lo:13: 00010000:00080000:2.0:1788651745.769417:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23aca80 x1875537147491840/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651761 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651745.769434:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147491840:0@lo:400: 00000100:00080000:0.0:1788651745.770698:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651745.770706:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000004:2.0:1788651745.952951:0:8956:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788651745.954456:0:8956:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788651746.784222:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651746.784254:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651746.784275:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147493120:0@lo:41: 00000100:00100000:2.0:1788651746.784355:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651746.784448:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147493120 00000100:00100000:2.0:1788651746.784456:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147493120 00000100:00100000:2.0:1788651746.784508:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788651746.784518:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147493120:12345-0@lo:41: 00000004:00000024:2.0:1788651746.784558:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788651746.784609:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147493120:12345-0@lo:41: Request processed in 92us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651746.784616:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788651746.784663:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147493120:0@lo:41: 00000020:00000004:2.0:1788651746.884744:0:9004:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788651746.884753:0:9004:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:1.0:1788651747.809701:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651748.321148:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147493248:0@lo:41: 00000100:00100000:1.0:1788651748.321221:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651748.321549:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147493248 00000100:00100000:2.0:1788651748.321557:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147493248 00000100:00100000:2.0:1788651748.321608:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788651748.321617:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147493248:12345-0@lo:41: 00000004:00000024:2.0:1788651748.321650:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788651748.322375:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147493248:12345-0@lo:41: Request processed in 757us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651748.322384:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788651748.322438:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147493248:0@lo:41: 00010000:00010000:3.0:1788651748.833456:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651749.857205:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651750.889588:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147493376:0@lo:13: 00000100:00100000:2.0:1788651750.889669:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651750.889748:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651750.889755:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147493504:0@lo:13: 00000100:00100000:2.0:1788651750.889777:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651750.889819:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147493376 00000100:00100000:2.0:1788651750.889827:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147493376 00000100:00100000:2.0:1788651750.889881:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147493504 00000100:00100000:2.0:1788651750.889884:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147493504 00000100:00100000:2.0:1788651750.889947:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788651750.889956:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147493376:12345-0@lo:13: 00002000:00000024:2.0:1788651750.889986:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651750.890031:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaeca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147493376:12345-0@lo:13: Request processed in 76us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651750.890038:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788651750.890053:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788651750.890060:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147493504:12345-0@lo:13: 00002000:00000024:2.0:1788651750.890069:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651750.890091:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147493504:12345-0@lo:13: Request processed in 33us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651750.890097:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788651750.890111:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788651750.890138:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeaedc00 x1875537147493504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651750.890156:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147493504:0@lo:13: 00010000:00080000:2.0:1788651750.890167:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23ac000 x1875537147493376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651766 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651750.890178:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147493376:0@lo:13: 00000100:00100000:1.0:1788651750.891163:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147493632:0@lo:400: 00000100:00100000:1.0:1788651750.891235:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651750.891271:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651750.891277:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147493760:0@lo:400: 00000100:00100000:1.0:1788651750.891305:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651750.891492:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651750.891722:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147493760 00000100:00100000:3.0:1788651750.891730:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147493760 00000100:00100000:3.0:1788651750.891782:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788651750.891791:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147493760:12345-0@lo:400: 00000100:00100000:3.0:1788651750.892499:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147493760:12345-0@lo:400: Request processed in 707us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651750.892509:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788651750.892608:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeaee300 x1875537147493760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651750.892626:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147493760:0@lo:400: 00000100:00100000:0.0:1788651750.892850:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147494144:0@lo:400: 00000100:00100000:0.0:1788651750.892924:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651750.893084:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147494144 00000100:00100000:3.0:1788651750.893090:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147494144 00000100:00100000:3.0:1788651750.893127:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788651750.893134:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147494144:12345-0@lo:400: 00000100:00100000:1.0:1788651750.893230:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147494016:0@lo:400: 00000100:00100000:1.0:1788651750.893264:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651750.893287:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147493888:0@lo:400: 00000100:00100000:1.0:1788651750.893308:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788651750.893520:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651750.893532:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147494016 00000100:00100000:1.0:1788651750.893536:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147494016 00000100:00100000:1.0:1788651750.893568:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788651750.893575:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147494016:12345-0@lo:400: 00000100:00100000:1.0:1788651750.893613:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147494016:12345-0@lo:400: Request processed in 39us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651750.893620:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788651750.894051:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeaec000 x1875537147494016/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651750.894062:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147494016:0@lo:400: 00000100:00100000:2.0:1788651750.894481:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147494272:0@lo:400: 00000100:00100000:2.0:1788651750.894520:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651750.894558:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147494400:0@lo:400: 00000100:00100000:2.0:1788651750.894581:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651750.894610:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147493632 00000100:00100000:2.0:1788651750.894615:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147493632 00000100:00100000:2.0:1788651750.894667:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788651750.894673:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3637:x1875537147493632:12345-0@lo:400: 00000100:00100000:2.0:1788651750.894723:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3637:x1875537147493632:12345-0@lo:400: Request processed in 50us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651750.894729:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1788651750.894758:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147494272 00000100:00100000:2.0:1788651750.894762:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147494272 00000100:00100000:2.0:1788651750.894793:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147494400 00000100:00100000:2.0:1788651750.894796:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147494400 00000100:00100000:2.0:1788651750.894811:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788651750.894817:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147494272:12345-0@lo:400: 00000100:00100000:2.0:1788651750.894863:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147494272:12345-0@lo:400: Request processed in 46us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651750.894869:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788651750.894880:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788651750.894886:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147494400:12345-0@lo:400: 00000100:00100000:2.0:1788651750.894959:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147494400:12345-0@lo:400: Request processed in 72us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651750.894965:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788651750.894983:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788651750.894987:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788651750.895005:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeaec380 x1875537147494272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651750.895015:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147494272:0@lo:400: 00010000:00080000:2.0:1788651750.895037:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeaedf80 x1875537147494400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651766 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651750.895045:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147494400:0@lo:400: 00000100:00100000:3.0:1788651750.895461:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147494144:12345-0@lo:400: Request processed in 2326us (2553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651750.895470:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788651750.895485:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147493888 00000100:00100000:3.0:1788651750.895489:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147493888 00000100:00100000:3.0:1788651750.895507:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788651750.895513:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147493888:12345-0@lo:400: 00000100:00100000:3.0:1788651750.895568:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147493888:12345-0@lo:400: Request processed in 55us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651750.895574:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788651750.895995:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147493888:0@lo:400: 00000100:00100000:0.0:1788651750.901227:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147494144:0@lo:400: 00000100:00100000:1.0:1788651750.910484:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147493632:0@lo:400: 00000100:00100000:2.0:1788651751.909140:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147494528:0@lo:41: 00010000:00010000:3.0:1788651751.910777:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651751.911118:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651751.911783:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147494528 00000100:00100000:3.0:1788651751.911796:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147494528 00000100:00100000:3.0:1788651751.911846:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788651751.911857:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147494528:12345-0@lo:41: 00000004:00000024:3.0:1788651751.911938:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:3.0:1788651751.912005:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147494528:12345-0@lo:41: Request processed in 150us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651751.912012:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788651751.912325:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147494528:0@lo:41: 00010000:00010000:1.0:1788651752.930450:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651753.445116:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651753.445145:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147494656:0@lo:41: 00000100:00100000:0.0:1788651753.445232:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651753.445492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147494656 00000100:00100000:2.0:1788651753.445501:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147494656 00000100:00100000:2.0:1788651753.445553:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788651753.445563:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147494656:12345-0@lo:41: 00000004:00000024:2.0:1788651753.445593:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788651753.445642:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147494656:12345-0@lo:41: Request processed in 80us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651753.445658:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788651753.445703:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147494656:0@lo:41: 00010000:00010000:2.0:1788651753.959174:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651754.977892:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651756.000472:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651756.001378:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651756.001402:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147494784:0@lo:13: 00000100:00100000:1.0:1788651756.001483:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651756.004440:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651756.004469:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147494912:0@lo:400: 00000100:00100000:3.0:1788651756.004543:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651756.004602:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147494912 00000100:00100000:3.0:1788651756.004610:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147494912 00000100:00100000:3.0:1788651756.004667:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788651756.004677:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3636:x1875537147494912:12345-0@lo:400: 00000100:00100000:3.0:1788651756.004738:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3636:x1875537147494912:12345-0@lo:400: Request processed in 62us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651756.004746:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788651756.004834:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147495168:0@lo:400: 00000100:00100000:1.0:1788651756.004834:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147495040:0@lo:400: 00000100:00100000:3.0:1788651756.004860:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651756.004870:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651756.004891:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147495168 00000100:00100000:3.0:1788651756.004895:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147495168 00000100:00100000:1.0:1788651756.004905:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147494912:0@lo:400: 00000100:00100000:3.0:1788651756.004936:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788651756.004949:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147495040 00000100:00100000:3.0:1788651756.004950:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147495168:12345-0@lo:400: 00000100:00100000:1.0:1788651756.004952:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147495040 00000100:00100000:1.0:1788651756.004980:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651756.004987:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147495168:12345-0@lo:400: Request processed in 38us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651756.004987:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147495040:12345-0@lo:400: 00000100:00100000:3.0:1788651756.004993:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788651756.005021:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147495168:0@lo:400: 00000100:00100000:1.0:1788651756.005021:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147495040:12345-0@lo:400: Request processed in 34us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651756.005033:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651756.005045:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651756.005051:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147495296:0@lo:400: 00010000:00080000:1.0:1788651756.005063:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c1a35880 x1875537147495040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651756.005072:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651756.005074:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147495040:0@lo:400: 00000100:00100000:3.0:1788651756.005093:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147495296 00000100:00100000:3.0:1788651756.005097:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147495296 00000100:00100000:3.0:1788651756.005125:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788651756.005130:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147495296:12345-0@lo:400: 00000100:00100000:3.0:1788651756.005164:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147495296:12345-0@lo:400: Request processed in 33us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651756.005170:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788651756.005193:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeb51c00 x1875537147495296/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651756.005202:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147495296:0@lo:400: 00000100:00100000:3.0:1788651756.005236:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651756.005243:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147495424:0@lo:400: 00000100:00100000:3.0:1788651756.005264:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651756.005289:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147495424 00000100:00100000:3.0:1788651756.005293:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147495424 00000100:00100000:3.0:1788651756.005317:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788651756.005323:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147495424:12345-0@lo:400: 00000100:00100000:3.0:1788651756.005356:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147495424:12345-0@lo:400: Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651756.005368:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788651756.005396:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147495424:0@lo:400: 00000100:00100000:3.0:1788651756.005424:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147495552:0@lo:400: 00000100:00100000:3.0:1788651756.005447:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651756.005472:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147495552 00000100:00100000:3.0:1788651756.005476:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147495552 00000100:00100000:3.0:1788651756.005509:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788651756.005514:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147495552:12345-0@lo:400: 00000100:00100000:3.0:1788651756.005547:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147495552:12345-0@lo:400: Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651756.005553:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788651756.005568:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788651756.005585:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeb51c00 x1875537147495552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651756.005594:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147495552:0@lo:400: 00000100:00100000:3.0:1788651756.005623:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147495680:0@lo:400: 00000100:00100000:3.0:1788651756.005643:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651756.005664:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147495680 00000100:00100000:3.0:1788651756.005667:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147495680 00000100:00100000:3.0:1788651756.005691:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788651756.005697:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147495680:12345-0@lo:400: 00000100:00100000:3.0:1788651756.005727:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147495680:12345-0@lo:400: Request processed in 31us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651756.005733:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788651756.005745:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788651756.005770:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeb51c00 x1875537147495680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651756.005778:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147495680:0@lo:400: 00000100:00100000:3.0:1788651756.005817:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651756.005825:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147495808:0@lo:400: 00000100:00100000:3.0:1788651756.005849:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651756.005876:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147495808 00000100:00100000:3.0:1788651756.005879:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147495808 00000100:00100000:3.0:1788651756.005940:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788651756.005947:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147495808:12345-0@lo:400: 00000100:00100000:3.0:1788651756.005980:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147495808:12345-0@lo:400: Request processed in 34us (130us total) trans 0 rc 0/0 00000100:00080000:1.0:1788651756.005983:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651756.005986:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788651756.006014:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeb51c00 x1875537147495808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651772 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651756.006022:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147495808:0@lo:400: 00000100:00100000:2.0:1788651756.006309:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147494784 00000100:00100000:2.0:1788651756.006314:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147494784 00000100:00100000:2.0:1788651756.006345:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788651756.006352:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147494784:12345-0@lo:13: 00002000:00000024:2.0:1788651756.006375:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651756.006417:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147494784:12345-0@lo:13: Request processed in 66us (4935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651756.006424:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788651756.006665:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147495936:0@lo:13: 00000100:00100000:1.0:1788651756.006695:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651756.006743:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147495936 00000100:00100000:1.0:1788651756.006747:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147495936 00000100:00100000:1.0:1788651756.006766:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788651756.006772:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147495936:12345-0@lo:13: 00002000:00000024:1.0:1788651756.006782:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651756.006825:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147495936:12345-0@lo:13: Request processed in 53us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651756.006831:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788651756.006844:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788651756.006861:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeaedf80 x1875537147495936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651756.006875:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147495936:0@lo:13: 00010000:00080000:3.0:1788651756.013897:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86ea15c000 x1875537147494784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651756.013956:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147494784:0@lo:13: 00010000:00010000:1.0:1788651757.026754:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651757.035454:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651757.035489:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147496064:0@lo:41: 00000100:00100000:1.0:1788651757.035581:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651757.039188:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147496064 00000100:00100000:0.0:1788651757.039204:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147496064 00000100:00100000:0.0:1788651757.039284:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788651757.039295:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147496064:12345-0@lo:41: 00000004:00000024:0.0:1788651757.039332:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788651757.039437:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147496064:12345-0@lo:41: Request processed in 144us (3855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651757.039444:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788651757.039504:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147496064:0@lo:41: 00010000:00010000:1.0:1788651758.049341:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788651758.069617:0:9504:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788651758.069621:0:9504:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788651758.069623:0:9504:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788651758.070067:0:9504:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f85c196d800 00000020:01000004:3.0:1788651758.070083:0:9504:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788651758.070278:0:9504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788651758.070293:0:9504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f86f560cd40) 00000020:00000080:3.0:1788651758.070311:0:9504:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788651758.125676:0:9504:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788651758.130698:0:9504:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:3.0:1788651758.174805:0:9504:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788651758.185417:0:9504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788651758.185436:0:9504:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788651758.185450:0:9504:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd2f56ea038c3a9c 00000020:01000004:0.0:1788651758.185459:0:9504:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788651758.185485:0:9504:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.145@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788651758.185489:0:9504:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788651758.185495:0:9504:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788651758.185531:0:9504:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788651758.185536:0:9504:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788651758.214291:0:9504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788651758.214336:0:9504:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.145@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1788651758.214345:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788651758.214346:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788651758.214347:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651758.214348:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788651758.214350:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651758.214351:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651758.214352:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788651758.214353:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788651758.214355:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788651758.214356:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651758.214357:0:9504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788651758.214361:0:9504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1788651758.214363:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788651758.214365:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788651758.214366:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651758.214367:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788651758.214367:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651758.214368:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651758.214369:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788651758.214370:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788651758.214371:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788651758.214372:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651758.214373:0:9504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788651758.214403:0:9504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788651758.214477:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147496192:0@lo:253: 00000100:00100000:0.0:1788651758.214574:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651758.214639:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651758.214706:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147496192 00000100:00100000:2.0:1788651758.214714:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147496192 00000100:00100000:2.0:1788651758.214834:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788651758.214845:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:9504:x1875537147496192:12345-0@lo:253: 20000000:01000000:2.0:1788651758.214878:0:6504:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788651758.214889:0:6504:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788651758.214895:0:6504:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788651758.214898:0:6504:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788651758.215176:0:6504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651758.215301:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:2.0:1788651758.215317:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788651758.215335:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:2.0:1788651758.215340:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788651758.215354:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:2.0:1788651758.215367:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:2.0:1788651758.215465:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:2.0:1788651758.215480:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.145@tcp 20000000:01000000:2.0:1788651758.215482:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.145@tcp (null) (null) (null) 00000040:00080000:2.0:1788651758.215499:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:2.0:1788651758.215505:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788651758.215519:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:2.0:1788651758.215525:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.145@tcp (null) (null) 00000040:00080000:2.0:1788651758.215538:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:2.0:1788651758.215543:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788651758.215555:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:2.0:1788651758.215571:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:2.0:1788651758.215641:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:2.0:1788651758.215653:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.145@tcp 20000000:01000000:2.0:1788651758.215655:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.145@tcp (null) (null) (null) 00000040:00080000:2.0:1788651758.215667:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:2.0:1788651758.215672:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788651758.215684:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:2.0:1788651758.215688:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.204.145@tcp (null) (null) 00000040:00080000:2.0:1788651758.215700:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:2.0:1788651758.215705:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788651758.215715:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:2.0:1788651758.215741:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:2.0:1788651758.216151:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:2.0:1788651758.216163:0:6504:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.145@tcp 20000000:01000000:2.0:1788651758.216164:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.145@tcp (null) (null) (null) 00000040:00080000:2.0:1788651758.216179:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:2.0:1788651758.216184:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788651758.216197:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:2.0:1788651758.216202:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.145@tcp (null) (null) 00000040:00080000:2.0:1788651758.216213:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:2.0:1788651758.216219:0:6504:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788651758.216230:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:2.0:1788651758.216242:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:2.0:1788651758.216254:0:6504:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788651758.216256:0:6504:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788651758.216260:0:6504:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788651758.216305:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788651758.216308:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788651758.217674:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:2.0:1788651758.217713:0:9510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:2.0:1788651758.217732:0:9510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:3.0:1788651758.218249:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:3.0:1788651758.218280:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:3.0:1788651758.218297:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:3.0:1788651758.218308:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788651758.218311:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788651758.218661:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 26 1->4: lustre sys.timeout 20000000:01000000:1.0:1788651758.218683:0:9511:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 26 2->4: lustre sys.timeout 00000040:00080000:1.0:1788651758.218712:0:9511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1788651758.218883:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1788651758.219475:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1788651758.219507:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1788651758.219523:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:3.0:1788651758.219525:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788651758.219800:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:0.0:1788651758.219833:0:9512:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:0.0:1788651758.219845:0:9512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:3.0:1788651758.220225:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:3.0:1788651758.220245:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:3.0:1788651758.220256:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:3.0:1788651758.220264:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788651758.220266:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788651758.220584:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 28 1->4: lustre sys.timeout 20000000:01000000:0.0:1788651758.220609:0:9513:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 28 2->4: lustre sys.timeout 00000040:00080000:0.0:1788651758.220618:0:9513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788651758.220766:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788651758.220785:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:3.0:1788651758.220798:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:3.0:1788651758.220805:0:6504:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788651758.220807:0:6504:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788651758.221220:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:3.0:1788651758.221353:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:3.0:1788651758.221370:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:3.0:1788651758.221396:0:6504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 10000000:01000000:3.0:1788651758.221411:0:6504:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788651758.221494:0:6504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221514:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c3999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3992 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221522:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c39c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c39bc expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221540:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c39fb expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221546:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c3a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a17 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221553:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a41 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221559:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3a64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a5d expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221567:0:6504:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a80 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221575:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221613:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3a80 expref: 21 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221629:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3a87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a80 expref: 21 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.221644:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147496320:0@lo:104: 00000100:00100000:3.0:1788651758.221702:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651758.221792:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3a5d expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221800:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3a64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a5d expref: 21 pid: 6504 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.221815:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147496448:0@lo:104: 00000100:00100000:3.0:1788651758.221834:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651758.221903:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3a41 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.221938:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3a48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a41 expref: 21 pid: 6502 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.221947:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147496576:0@lo:104: 00000100:00100000:3.0:1788651758.221965:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651758.222179:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147496320 00000100:00100000:0.0:1788651758.222186:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147496320 00000100:00100000:0.0:1788651758.222227:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147496448 00000100:00100000:0.0:1788651758.222229:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147496448 00000100:00100000:0.0:1788651758.222240:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788651758.222248:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6504:x1875537147496320:12345-0@lo:104: 00010000:00010000:0.0:1788651758.222263:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651758.222342:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788651758.222349:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6504:x1875537147496320:12345-0@lo:104: Request processed in 102us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651758.222357:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788651758.222375:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788651758.222380:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6504:x1875537147496448:12345-0@lo:104: 00010000:00010000:0.0:1788651758.222388:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222483:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788651758.222491:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222499:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f8600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651758.222503:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222511:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651758.222518:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651758.222524:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651758.222560:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222567:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651758.222585:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222592:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c3a80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a87 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222608:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651758.222611:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222627:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651758.222630:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222636:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651758.222643:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651758.222647:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651758.222658:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222663:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651758.222667:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222673:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4200/0xcd2f56ea038c3a5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a64 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222681:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651758.222683:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651758.222685:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651758.222699:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147496704:0@lo:103: 00000100:00100000:1.0:1788651758.222726:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651758.222765:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651758.222771:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147496832:0@lo:103: 00000100:00100000:1.0:1788651758.222797:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651758.222829:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147496704 00000100:00100000:1.0:1788651758.222833:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147496704 00010000:00010000:1.0:1788651758.222853:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3a87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a80 expref: 22 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651758.222873:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147496832 00000100:00100000:1.0:1788651758.222875:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147496832 00010000:00010000:1.0:1788651758.222883:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3a64 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a5d expref: 23 pid: 6504 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651758.222897:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788651758.222902:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:3637:x1875537147496704:12345-0@lo:103: 00010000:00010000:1.0:1788651758.222940:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651758.222945:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3a87 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a80 expref: 23 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222956:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3a87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a80 expref: 23 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.222971:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651758.223100:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c3a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3a17 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.223110:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c3a1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a17 expref: 23 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.223118:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147496960:0@lo:104: 00000100:00100000:3.0:1788651758.223139:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651758.223152:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c39fb expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.223159:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c39fb expref: 23 pid: 6502 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.223167:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147497088:0@lo:104: 00000100:00100000:3.0:1788651758.223180:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651758.223190:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c39c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c39bc expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.223208:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c39c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c39bc expref: 23 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.223216:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147497216:0@lo:104: 00000100:00100000:3.0:1788651758.223235:0:6504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651758.223248:0:6504:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c3999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3992 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.223255:0:6504:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c3999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3992 expref: 23 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.223263:0:6504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147497344:0@lo:104: 00000100:00100000:3.0:1788651758.223275:0:6504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045ecc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788651758.223293:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3a87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3a80 expref: 23 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.223303:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147496320:0@lo:104: 00000100:00100000:3.0:1788651758.223310:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147496448:0@lo:104: 00000100:00100000:2.0:1788651758.223420:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147496576 00000100:00100000:2.0:1788651758.223433:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147496576 00000100:00100000:2.0:1788651758.223467:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788651758.223485:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.223495:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788651758.223500:0:6494:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1788651758.223685:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3637:x1875537147496704:12345-0@lo:103: Request processed in 782us (957us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651758.223692:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788651758.223708:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788651758.223715:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3637:x1875537147496832:12345-0@lo:103: 00010000:00010000:1.0:1788651758.223723:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651758.223728:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3a64 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a5d expref: 21 pid: 6504 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.223748:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3a64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a5d expref: 21 pid: 6504 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.223771:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3a64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3a5d expref: 21 pid: 6504 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.223780:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651758.223803:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:3637:x1875537147496832:12345-0@lo:103: Request processed in 89us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651758.223808:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788651758.223883:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147496832:0@lo:103: 00000100:00100000:3.0:1788651758.223891:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147496704:0@lo:103: 00000100:00100000:3.0:1788651758.224210:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147496960 00000100:00100000:3.0:1788651758.224215:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147496960 00000100:00100000:3.0:1788651758.224235:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788651758.224253:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147497088 00000100:00100000:3.0:1788651758.224257:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147497088 00000100:00100000:3.0:1788651758.224269:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788651758.224275:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147497216 00000100:00100000:3.0:1788651758.224282:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147497216 00000100:00100000:3.0:1788651758.224295:0:6494:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788651758.224298:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147497344 00000100:00100000:3.0:1788651758.224301:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147497344 00000100:00100000:2.0:1788651758.224391:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788651758.224398:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+8:6504:x1875537147496576:12345-0@lo:104: 00010000:00010000:2.0:1788651758.224409:0:9515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.224517:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788651758.224528:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+8:6504:x1875537147496576:12345-0@lo:104: Request processed in 131us (2562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.224534:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788651758.224548:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788651758.224553:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+7:6504:x1875537147496960:12345-0@lo:104: 00010000:00010000:2.0:1788651758.224560:0:9515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.224589:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788651758.224593:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+7:6504:x1875537147496960:12345-0@lo:104: Request processed in 41us (1454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.224599:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788651758.224608:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788651758.224613:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:6504:x1875537147497088:12345-0@lo:104: 00010000:00010000:2.0:1788651758.224620:0:9515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.224641:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788651758.224645:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:6504:x1875537147497088:12345-0@lo:104: Request processed in 33us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.224650:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788651758.224659:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788651758.224663:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c20a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:6504:x1875537147497216:12345-0@lo:104: 00010000:00010000:2.0:1788651758.224669:0:9515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.224689:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788651758.224698:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c20a4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:6504:x1875537147497216:12345-0@lo:104: Request processed in 34us (1461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.224703:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788651758.224713:0:9515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788651758.224718:0:9515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6504:x1875537147497344:12345-0@lo:104: 00010000:00010000:2.0:1788651758.224725:0:9515:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.224747:0:9515:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788651758.224763:0:9515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6504:x1875537147497344:12345-0@lo:104: Request processed in 45us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.224768:0:9515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788651758.224823:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147496576:0@lo:104: 00000100:00100000:3.0:1788651758.224831:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147496960:0@lo:104: 00000100:00100000:3.0:1788651758.224837:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147497088:0@lo:104: 00000100:00100000:3.0:1788651758.224843:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147497216:0@lo:104: 00000100:00100000:3.0:1788651758.224849:0:6504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:6504:1875537147497344:0@lo:104: 00010000:00010000:3.0:1788651758.224874:0:6504:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.224942:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788651758.224948:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.224956:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651758.224960:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.224968:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651758.224975:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651758.224981:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651758.225165:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225172:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651758.225212:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225219:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c0031800/0xcd2f56ea038c3a41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a48 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225233:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788651758.225236:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225242:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651758.225245:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225251:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651758.225258:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651758.225262:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651758.225275:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225281:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651758.225286:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225292:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c3a17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a1e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225302:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788651758.225312:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225316:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651758.225319:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225325:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651758.225331:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651758.225335:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651758.225349:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225354:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651758.225371:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225377:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c39fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a02 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225384:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788651758.225387:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225392:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dca00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651758.225395:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.225411:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651758.225416:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651758.225421:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788651758.225499:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147497600:0@lo:103: 00000100:00100000:3.0:1788651758.225538:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.225573:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651758.225578:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147497472:0@lo:103: 00000100:00100000:3.0:1788651758.225597:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.225622:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147497600 00000100:00100000:3.0:1788651758.225627:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147497600 00010000:00010000:3.0:1788651758.225646:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c3a1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a17 expref: 20 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.225666:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147497472 00000100:00100000:3.0:1788651758.225669:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147497472 00010000:00010000:3.0:1788651758.225679:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3a48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a41 expref: 21 pid: 6502 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.225696:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788651758.225702:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3636:x1875537147497600:12345-0@lo:103: 00010000:00010000:3.0:1788651758.225719:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651758.225725:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c3a1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a17 expref: 21 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.225733:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c3a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a17 expref: 21 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.225745:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c3a1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3a17 expref: 21 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.225767:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651758.225796:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:3636:x1875537147497600:12345-0@lo:103: Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.225802:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788651758.225816:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788651758.225821:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d286ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:3636:x1875537147497472:12345-0@lo:103: 00010000:00010000:3.0:1788651758.225828:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651758.225832:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3a48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a41 expref: 19 pid: 6502 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.225840:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a41 expref: 19 pid: 6502 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.225849:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3a48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3a41 expref: 19 pid: 6502 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.225857:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651758.225874:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d286ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:3636:x1875537147497472:12345-0@lo:103: Request processed in 53us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.225878:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788651758.225954:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147497472:0@lo:103: 00000100:00100000:3.0:1788651758.225961:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147497600:0@lo:103: 00010000:00010000:1.0:1788651758.226159:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.226165:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651758.226171:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.226177:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c29dca00/0xcd2f56ea038c39bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c39c3 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.226187:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651758.226191:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.226196:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651758.226198:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.226204:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651758.226210:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651758.226221:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788651758.226233:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.226239:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651758.226257:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.226264:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c3992 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3999 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.226277:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651758.226278:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651758.226280:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651758.226286:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651758.226298:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147497856:0@lo:103: 00000100:00100000:1.0:1788651758.226326:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651758.226346:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651758.226351:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147497728:0@lo:103: 00000100:00100000:1.0:1788651758.226369:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651758.226393:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147497856 00000100:00100000:1.0:1788651758.226398:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147497856 00010000:00010000:1.0:1788651758.226415:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c39c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c39bc expref: 18 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651758.226544:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147497984:0@lo:103: 00000100:00100000:2.0:1788651758.226572:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.226641:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147497728 00000100:00100000:3.0:1788651758.226645:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147497728 00010000:00010000:3.0:1788651758.226659:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c39fb expref: 19 pid: 6502 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.226687:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147497984 00000100:00100000:3.0:1788651758.226691:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147497984 00010000:00010000:3.0:1788651758.226701:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c3999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3992 expref: 20 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.226714:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788651758.226719:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:3638:x1875537147497728:12345-0@lo:103: 00010000:00010000:3.0:1788651758.226727:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651758.226731:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3a02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c39fb expref: 20 pid: 6502 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.226740:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c39fb expref: 20 pid: 6502 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.226762:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f9e00/0xcd2f56ea038c3a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c39fb expref: 20 pid: 6502 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.226772:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651758.226805:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:3638:x1875537147497728:12345-0@lo:103: Request processed in 85us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.226811:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788651758.226824:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788651758.226837:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:3635:x1875537147497984:12345-0@lo:103: 00010000:00010000:3.0:1788651758.226846:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651758.226851:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c3999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3992 expref: 18 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.226858:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c3999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3992 expref: 18 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.226867:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c29dd400/0xcd2f56ea038c3999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3992 expref: 18 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.226877:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651758.226927:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:3635:x1875537147497984:12345-0@lo:103: Request processed in 69us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.226934:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788651758.226963:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147497728:0@lo:103: 00000100:00100000:3.0:1788651758.227475:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147497984:0@lo:103: 00000100:00100000:1.0:1788651758.227542:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788651758.227553:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:3638:x1875537147497856:12345-0@lo:103: 00010000:00010000:1.0:1788651758.227563:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651758.227574:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c39c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c39bc expref: 16 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227585:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c39c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c39bc expref: 16 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227596:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c39c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c39bc expref: 16 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227609:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227618:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227633:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227639:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227646:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227652:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227657:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651758.227661:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227670:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227690:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.227700:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651758.227738:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:3638:x1875537147497856:12345-0@lo:103: Request processed in 188us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651758.227745:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788651758.227789:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147497856:0@lo:103: 00010000:00010000:1.0:1788651758.227807:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651758.227854:0:6504:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.227862:0:6504:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.227868:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3aa3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788651758.227881:0:6504:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:0.0:1788651758.228413:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788651758.228436:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6504:x1875537147496448:12345-0@lo:104: Request processed in 6042us (6586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651758.228444:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788651758.230860:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:9504:x1875537147496192:12345-0@lo:253: Request processed in 16008us (16276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.230893:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788651758.231203:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147496192:0@lo:253: 10000000:01000000:0.0:1788651758.231219:0:9504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788651758.231222:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788651758.231224:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788651758.231226:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788651758.231227:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788651758.231229:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788651758.231230:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788651758.231231:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788651758.231233:0:9504:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788651758.231242:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788651758.231243:0:9504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788651758.231267:0:9504:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f85c196d800 from lustre-OST0001 10000000:01000000:0.0:1788651758.231301:0:9504:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788651758.231305:0:9504:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788651758.231315:0:9504:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f86da6c3380 local copy 10000000:01000000:0.0:1788651758.231319:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788651758.231360:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651758.231372:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651758.231383:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651758.231405:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498112:0@lo:101: 00000100:00100000:0.0:1788651758.231463:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651758.231503:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788651758.231590:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147498112 00000100:00100000:3.0:1788651758.231597:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147498112 00000100:00100000:3.0:1788651758.231642:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788651758.231652:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:9504:x1875537147498112:12345-0@lo:101: 00010000:00010000:3.0:1788651758.231666:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651758.231680:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c1502600/0xcd2f56ea038c3ab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3aaa expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.231707:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1502600/0xcd2f56ea038c3ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3aaa expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.231720:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c1502600/0xcd2f56ea038c3ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3aaa expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.231729:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502600, rc 0) 00000100:00100000:3.0:1788651758.231785:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147498112:12345-0@lo:101: Request processed in 134us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.231791:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788651758.231893:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498112:0@lo:101: 00010000:00010000:0.0:1788651758.231938:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651758.231949:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651758.232254:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498240:0@lo:501: 00000100:00100000:0.0:1788651758.232285:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651758.232311:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788651758.232360:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147498240 00000100:00100000:3.0:1788651758.232365:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147498240 00000100:00100000:3.0:1788651758.232406:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788651758.232414:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147498240:12345-0@lo:501: 00000100:00100000:3.0:1788651758.232494:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147498240:12345-0@lo:501: Request processed in 81us (208us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788651758.232500:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788651758.232595:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498240:0@lo:501: 10000000:01000000:1.0:1788651758.232607:0:9504:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788651758.232627:0:9504:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788651758.232633:0:9504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.232641:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.232648:0:9504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.232762:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651758.232771:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.232780:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651758.232784:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.232793:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651758.232801:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651758.232807:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651758.232843:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.232849:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651758.232881:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.232891:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651758.232892:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651758.232894:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651758.233302:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147498368:0@lo:103: 00000100:00100000:3.0:1788651758.233345:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.233445:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147498368 00000100:00100000:2.0:1788651758.233452:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147498368 00000100:00100000:2.0:1788651758.233497:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788651758.233505:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:3636:x1875537147498368:12345-0@lo:103: 00010000:00010000:2.0:1788651758.233516:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651758.233530:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1502600/0xcd2f56ea038c3ab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3aaa expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.233544:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651758.233577:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:3636:x1875537147498368:12345-0@lo:103: Request processed in 73us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.233583:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788651758.233679:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147498368:0@lo:103: 00010000:00010000:1.0:1788651758.233768:0:9504:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788651758.233774:0:9504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3aaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xcd2f56ea038c3ab1 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651758.233812:0:9504:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f85c196d800 00010000:00010000:2.0:1788651758.234328:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788651758.234341:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788651758.234348:0:9504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788651758.234352:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788651758.234357:0:9504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788651758.234361:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788651758.234390:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.234411:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.234421:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651758.234447:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498496:0@lo:101: 00000100:00100000:2.0:1788651758.234484:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.234517:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e09c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651758.234563:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147498496 00000100:00100000:1.0:1788651758.234574:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147498496 00000100:00100000:1.0:1788651758.234617:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788651758.234625:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+14:9504:x1875537147498496:12345-0@lo:101: 00010000:00010000:1.0:1788651758.234637:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651758.234649:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3abf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3ab8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.234667:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3abf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ab8 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.234677:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3abf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ab8 expref: 15 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.234684:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414000, rc 0) 00000100:00100000:1.0:1788651758.234724:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147498496:12345-0@lo:101: Request processed in 100us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651758.234730:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788651758.234853:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498496:0@lo:101: 00010000:00010000:2.0:1788651758.234868:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.234878:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651758.235164:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498624:0@lo:501: 00000100:00100000:2.0:1788651758.235192:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.235221:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651758.235269:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147498624 00000100:00100000:3.0:1788651758.235274:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147498624 00000100:00100000:3.0:1788651758.235303:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788651758.235311:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147498624:12345-0@lo:501: 00000100:00100000:3.0:1788651758.235431:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147498624:12345-0@lo:501: Request processed in 121us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.235438:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788651758.235643:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498624:0@lo:501: 00000100:00100000:2.0:1788651758.235687:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498752:0@lo:503: 00000100:00100000:2.0:1788651758.235722:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.235745:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e09c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651758.235804:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147498752 00000100:00100000:3.0:1788651758.235809:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147498752 00000100:00100000:3.0:1788651758.235846:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788651758.235853:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147498752:12345-0@lo:503: 00000100:00100000:3.0:1788651758.235961:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147498752:12345-0@lo:503: Request processed in 107us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.235968:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788651758.236151:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaef800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498752:0@lo:503: 00000040:00080000:3.0:1788651758.236434:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788651758.236511:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498880:0@lo:502: 00000100:00100000:3.0:1788651758.236547:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.236565:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651758.236581:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147498880 00000100:00100000:3.0:1788651758.236585:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147498880 00000100:00100000:3.0:1788651758.236607:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788651758.236613:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147498880:12345-0@lo:502: 00000100:00100000:3.0:1788651758.236699:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147498880:12345-0@lo:502: Request processed in 84us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.236713:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788651758.236769:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147498880:0@lo:502: 00000040:00080000:3.0:1788651758.237497:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788651758.237530:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788651758.237543:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788651758.237557:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788651758.237570:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788651758.237583:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788651758.237610:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499008:0@lo:502: 00000100:00100000:3.0:1788651758.237657:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.237727:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651758.237792:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147499008 00000100:00100000:0.0:1788651758.237799:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147499008 00000100:00100000:0.0:1788651758.237882:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788651758.237891:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147499008:12345-0@lo:502: 00000100:00100000:0.0:1788651758.238046:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147499008:12345-0@lo:502: Request processed in 156us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651758.238053:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788651758.238227:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499008:0@lo:502: 00000040:00080000:3.0:1788651758.238274:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788651758.238283:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788651758.238936:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788651758.238945:0:9516:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788651758.238953:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651758.238955:0:9516:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788651758.238966:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788651758.239000:0:9516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f85c2ae0000) 00000020:00000080:3.0:1788651758.239026:0:9516:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788651758.239033:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788651758.239131:0:9516:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f85c196d800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788651758.239140:0:9516:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788651758.239148:0:9516:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd2f56ea038c3acd 00010000:00010000:3.0:1788651758.248261:0:9516:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788651758.248635:0:9516:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788651758.254941:0:9516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788651758.256880:0:9516:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788651758.265124:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788651758.265311:0:9516:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788651758.277247:0:9516:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788651758.281519:0:9516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788651758.281533:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651758.281539:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651758.281541:0:9516:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788651758.281545:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651758.281548:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651758.281550:0:9516:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788651758.281553:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788651758.281555:0:9516:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788651758.281580:0:9516:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651758.281583:0:9516:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651758.281585:0:9516:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788651758.281587:0:9516:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788651758.286617:0:9504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788651758.286664:0:9504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788651758.286701:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.286714:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651758.286723:0:9504:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f85c196d800 from 1 10000000:01000000:2.0:1788651758.286726:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788651758.286773:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.286781:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.286792:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651758.286814:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499136:0@lo:101: 00000100:00100000:2.0:1788651758.286881:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.286949:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788651758.288144:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147499136 00000100:00100000:2.0:1788651758.288159:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147499136 00000100:00100000:2.0:1788651758.288217:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788651758.288226:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:9504:x1875537147499136:12345-0@lo:101: 00010000:00010000:2.0:1788651758.288242:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651758.288257:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3adb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3ad4 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.288283:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ad4 expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.288307:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ad4 expref: 16 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.288316:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd200, rc 0) 00000100:00100000:2.0:1788651758.288386:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9504:x1875537147499136:12345-0@lo:101: Request processed in 160us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.288393:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788651758.289054:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499136:0@lo:101: 00010000:00010000:3.0:1788651758.289081:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.289102:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.289213:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499264:0@lo:501: 00000100:00100000:3.0:1788651758.289253:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.289293:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12600 going to sleep for 11 seconds 00000100:00100000:1.0:1788651758.289826:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147499264 00000100:00100000:1.0:1788651758.289835:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147499264 00000100:00100000:1.0:1788651758.289876:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788651758.289883:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9504:x1875537147499264:12345-0@lo:501: 00000100:00100000:1.0:1788651758.290038:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9504:x1875537147499264:12345-0@lo:501: Request processed in 154us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651758.290045:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788651758.290540:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499264:0@lo:501: 00000100:00100000:3.0:1788651758.290584:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499392:0@lo:503: 00000100:00100000:3.0:1788651758.290638:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.290666:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12600 going to sleep for 11 seconds 00000100:00100000:2.0:1788651758.290937:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147499392 00000100:00100000:2.0:1788651758.290944:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147499392 00000100:00100000:2.0:1788651758.291047:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788651758.291058:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9504:x1875537147499392:12345-0@lo:503: 00000100:00100000:2.0:1788651758.291239:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9504:x1875537147499392:12345-0@lo:503: Request processed in 183us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.291247:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788651758.291256:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499392:0@lo:503: 00000040:00080000:3.0:1788651758.291528:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788651758.291603:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499520:0@lo:502: 00000100:00100000:3.0:1788651758.291638:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.291677:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12600 going to sleep for 11 seconds 00000100:00100000:1.0:1788651758.292385:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147499520 00000100:00100000:1.0:1788651758.292395:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147499520 00000100:00100000:1.0:1788651758.292456:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788651758.292464:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9504:x1875537147499520:12345-0@lo:502: 00000100:00100000:1.0:1788651758.292583:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9504:x1875537147499520:12345-0@lo:502: Request processed in 119us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651758.292596:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788651758.292621:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499520:0@lo:502: 00000040:00080000:3.0:1788651758.294285:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788651758.294333:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788651758.294377:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499648:0@lo:502: 00000100:00100000:3.0:1788651758.294439:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.294471:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12600 going to sleep for 11 seconds 00000100:00100000:2.0:1788651758.294667:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147499648 00000100:00100000:2.0:1788651758.294674:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147499648 00000100:00100000:2.0:1788651758.294728:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788651758.294736:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9504:x1875537147499648:12345-0@lo:502: 00000100:00100000:2.0:1788651758.294875:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9504:x1875537147499648:12345-0@lo:502: Request processed in 140us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.294883:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788651758.295664:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499648:0@lo:502: 00000040:00080000:0.0:1788651758.295762:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1788651758.295775:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788651758.299350:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651758.299370:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651758.299373:0:9520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788651758.299384:0:9520:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f85c196d800 00000020:00000080:1.0:1788651758.299387:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788651758.299403:0:9520:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651758.299406:0:9520:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651758.299408:0:9520:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788651758.299412:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788651758.300166:0:9504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788651758.300203:0:9504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788651758.300228:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651758.300240:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651758.300294:0:9504:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788651758.300298:0:9504:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f85c196d800 10000000:01000000:0.0:1788651758.300301:0:9504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f85c196d800 10000000:01000000:0.0:1788651758.300304:0:9504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788651758.300310:0:9504:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f85c196d800 from 1 10000000:01000000:0.0:1788651758.300313:0:9504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788651758.300356:0:9504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651758.300366:0:9504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651758.300378:0:9504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651758.300418:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499776:0@lo:101: 00000100:00100000:0.0:1788651758.300495:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651758.300545:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788651758.300636:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147499776 00000100:00100000:1.0:1788651758.300644:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147499776 00000100:00100000:1.0:1788651758.300701:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788651758.300713:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9504:x1875537147499776:12345-0@lo:101: 00010000:00010000:1.0:1788651758.300728:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651758.300742:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ae9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3ae2 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.300780:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ae2 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.300793:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ae2 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.300804:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415000, rc 0) 00000100:00100000:1.0:1788651758.300856:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9504:x1875537147499776:12345-0@lo:101: Request processed in 145us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651758.300863:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788651758.304403:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499776:0@lo:101: 00010000:00010000:0.0:1788651758.304435:0:9504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651758.304448:0:9504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651758.304580:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499904:0@lo:501: 00000100:00100000:0.0:1788651758.304639:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651758.304686:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8600 going to sleep for 11 seconds 00000100:00100000:3.0:1788651758.304737:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147499904 00000100:00100000:3.0:1788651758.304744:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147499904 00000100:00100000:3.0:1788651758.304805:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788651758.304814:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9504:x1875537147499904:12345-0@lo:501: 00000100:00100000:3.0:1788651758.304960:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9504:x1875537147499904:12345-0@lo:501: Request processed in 146us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.304969:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788651758.305301:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147499904:0@lo:501: 00000100:00100000:0.0:1788651758.305332:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147500032:0@lo:503: 00000100:00100000:0.0:1788651758.305386:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651758.305414:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8600 going to sleep for 11 seconds 00000100:00100000:2.0:1788651758.305463:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147500032 00000100:00100000:2.0:1788651758.305468:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147500032 00000100:00100000:2.0:1788651758.305505:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788651758.305512:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9504:x1875537147500032:12345-0@lo:503: 00000100:00100000:2.0:1788651758.305608:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9504:x1875537147500032:12345-0@lo:503: Request processed in 96us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.305622:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788651758.307033:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147500032:0@lo:503: 00000040:00080000:0.0:1788651758.307317:0:9504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788651758.307400:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147500160:0@lo:502: 00000100:00100000:0.0:1788651758.307472:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651758.307519:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8600 going to sleep for 11 seconds 00000100:00100000:1.0:1788651758.307639:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147500160 00000100:00100000:1.0:1788651758.307653:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147500160 00000100:00100000:1.0:1788651758.307689:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788651758.307697:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9504:x1875537147500160:12345-0@lo:502: 00000100:00100000:1.0:1788651758.307817:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9504:x1875537147500160:12345-0@lo:502: Request processed in 121us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651758.307825:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788651758.307902:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147500160:0@lo:502: 00000040:00080000:0.0:1788651758.308281:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788651758.308320:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788651758.308336:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788651758.308348:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788651758.308364:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788651758.308376:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788651758.308388:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788651758.308400:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788651758.308412:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788651758.308425:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788651758.308439:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788651758.308454:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788651758.308466:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788651758.308480:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788651758.308493:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788651758.308505:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788651758.308516:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788651758.308527:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788651758.308538:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788651758.308552:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788651758.308564:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788651758.308578:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788651758.308591:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788651758.308603:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788651758.308615:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:0.0:1788651758.308628:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:0.0:1788651758.308642:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:0.0:1788651758.308655:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:0.0:1788651758.308669:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1788651758.308682:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:0.0:1788651758.308696:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:0.0:1788651758.308725:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:0.0:1788651758.308741:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:0.0:1788651758.308768:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:0.0:1788651758.308795:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:0.0:1788651758.308810:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:0.0:1788651758.308824:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:0.0:1788651758.308838:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:0.0:1788651758.308852:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:0.0:1788651758.308865:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:0.0:1788651758.308879:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:0.0:1788651758.308893:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:1.0:1788651758.312026:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:1.0:1788651758.312119:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:1.0:1788651758.312140:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:1.0:1788651758.312155:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:1.0:1788651758.312209:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147500288:0@lo:502: 00000100:00100000:1.0:1788651758.312296:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651758.312347:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef600 going to sleep for 11 seconds 00000100:00100000:3.0:1788651758.312371:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147500288 00000100:00100000:3.0:1788651758.312379:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147500288 00000100:00100000:3.0:1788651758.312441:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788651758.312450:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9504:x1875537147500288:12345-0@lo:502: 00000100:00100000:3.0:1788651758.312637:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9504:x1875537147500288:12345-0@lo:502: Request processed in 188us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.312645:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788651758.312728:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147500288:0@lo:502: 00000040:00080000:1.0:1788651758.312783:0:9504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:1.0:1788651758.312792:0:9504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:1.0:1788651758.313437:0:9521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788651758.313454:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f85c20f99c0) 00000020:00000080:1.0:1788651758.313480:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:1.0:1788651758.313569:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f85c196d800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788651758.313573:0:9521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f85c196d800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788651758.313576:0:9521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f85c196d800 3 00010000:00080000:1.0:1788651758.313604:0:9521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c3181800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788651758.321411:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1788651758.321621:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788651758.321670:0:9521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788651758.321696:0:9521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcd2f56ea038c3af7 00000100:00080000:2.0:1788651758.321706:0:9521:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788651758.321713:0:9521:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f85c3181800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788651758.321761:0:9521:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86eeaef100 x1875537147500416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788651758.321790:0:9521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788651758.321864:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147500416:0@lo:38: 00000100:00100000:3.0:1788651758.321964:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.322018:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147500800:0@lo:400: 00000100:00100000:3.0:1788651758.322043:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.322078:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147501312:0@lo:400: 00000100:00100000:3.0:1788651758.322114:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.322135:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788651758.322140:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147500928:0@lo:400: 00000100:00100000:3.0:1788651758.322163:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.322179:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147501440:0@lo:400: 00000100:00100000:3.0:1788651758.322196:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.322225:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147500416 00000100:00100000:3.0:1788651758.322232:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147500416 00000100:00100000:3.0:1788651758.322261:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147500800 00000100:00100000:3.0:1788651758.322264:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147500800 00000100:00100000:3.0:1788651758.322287:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788651758.322296:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147500800:12345-0@lo:400: 00000100:00100000:3.0:1788651758.322345:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147500800:12345-0@lo:400: Request processed in 50us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.322352:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788651758.322366:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788651758.322370:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875537147500416:12345-0@lo:38: 00010000:00080000:3.0:1788651758.322389:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:3.0:1788651758.322429:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd2f56ea038c3afe 00000004:00100000:3.0:1788651758.322445:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788651758.322481:0:6511:0:(import.c:65:import_set_state_nolock()) ffff8f85c2ad8800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788651758.322520:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875537147500416:12345-0@lo:38: Request processed in 148us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.322532:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788651758.322552:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147501312 00000100:00100000:3.0:1788651758.322556:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147501312 00000100:00100000:3.0:1788651758.322584:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147501440 00000100:00100000:3.0:1788651758.322587:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147501440 00000100:00100000:3.0:1788651758.322604:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651758.322609:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147501312:12345-0@lo:400: 00000100:00100000:3.0:1788651758.322639:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147501312:12345-0@lo:400: Request processed in 30us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.322645:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651758.322655:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788651758.322660:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147501440:12345-0@lo:400: 00000100:00100000:3.0:1788651758.322683:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147501440:12345-0@lo:400: Request processed in 23us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.322689:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788651758.322706:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147500928 00000100:00100000:3.0:1788651758.322709:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147500928 00000100:00100000:3.0:1788651758.322733:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788651758.322740:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147500928:12345-0@lo:400: 00000100:00100000:3.0:1788651758.322787:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147500928:12345-0@lo:400: Request processed in 47us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.322792:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788651758.322815:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788651758.322852:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeaef100 x1875537147500416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788651768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651758.322862:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788651758.322871:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788651758.322886:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788651758.322890:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788651758.322893:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3181800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788651758.322899:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147500416:0@lo:38: 00000100:00100000:3.0:1788651758.322954:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147500928:0@lo:400: 00010000:00080000:3.0:1788651758.322965:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23af480 x1875537147501440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651758.322973:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147501440:0@lo:400: 00010000:00080000:3.0:1788651758.322982:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23ad180 x1875537147500800/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651758.322990:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147500800:0@lo:400: 00010000:00080000:3.0:1788651758.322998:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23af100 x1875537147501312/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651758.323006:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147501312:0@lo:400: 00000100:00100000:2.0:1788651758.323380:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147500544:0@lo:400: 00000100:00100000:2.0:1788651758.323420:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.323446:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147501056:0@lo:400: 00000100:00100000:2.0:1788651758.323467:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.323485:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788651758.323491:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147500672:0@lo:400: 00000100:00100000:2.0:1788651758.323514:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.323533:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147501184:0@lo:400: 00000100:00100000:2.0:1788651758.323552:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.323572:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147500544 00000100:00100000:2.0:1788651758.323576:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147500544 00000100:00100000:2.0:1788651758.323597:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147501056 00000100:00100000:2.0:1788651758.323599:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147501056 00000100:00100000:2.0:1788651758.323617:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147501184 00000100:00100000:2.0:1788651758.323620:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147501184 00000100:00100000:2.0:1788651758.323633:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788651758.323639:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147500544:12345-0@lo:400: 00000100:00100000:2.0:1788651758.323686:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147500544:12345-0@lo:400: Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.323693:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788651758.323706:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788651758.323711:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147501056:12345-0@lo:400: 00000100:00100000:2.0:1788651758.323735:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147501056:12345-0@lo:400: Request processed in 24us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.323740:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788651758.323763:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788651758.323770:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147501184:12345-0@lo:400: 00000100:00100000:2.0:1788651758.323794:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147501184:12345-0@lo:400: Request processed in 25us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.323800:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788651758.323818:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147500672 00000100:00100000:2.0:1788651758.323821:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147500672 00000100:00100000:2.0:1788651758.323841:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788651758.323847:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147500672:12345-0@lo:400: 00000100:00100000:2.0:1788651758.323873:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147500672:12345-0@lo:400: Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.323879:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788651758.323891:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788651758.323894:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651758.323937:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147500672:0@lo:400: 00010000:00080000:2.0:1788651758.323948:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23aea00 x1875537147501184/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651758.323957:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147501184:0@lo:400: 00010000:00080000:2.0:1788651758.323977:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23ace00 x1875537147500544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651758.323985:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147500544:0@lo:400: 00010000:00080000:2.0:1788651758.323994:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c23ae300 x1875537147501056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651758.324001:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147501056:0@lo:400: 00000020:01000004:2.0:1788651758.324221:0:9521:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788651758.324238:0:9521:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f85c29319c0) 00000020:00000080:2.0:1788651758.324262:0:9521:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1788651758.324335:0:9521:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f85c196d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788651758.324339:0:9521:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f85c196d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788651758.324341:0:9521:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f85c196d800 3 00010000:00080000:2.0:1788651758.324366:0:9521:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c32ce000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.145@tcp at head 00000100:00100000:3.0:1788651758.325316:0:9522:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9522:1875537147501568:0@lo:901: 00000100:00100000:3.0:1788651758.325371:0:9522:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.325413:0:9522:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651758.326396:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147501568 00000100:00100000:0.0:1788651758.326406:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147501568 00000100:00100000:0.0:1788651758.326486:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788651758.326495:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9522:x1875537147501568:12345-0@lo:901: 00000100:00100000:0.0:1788651758.326608:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9522:x1875537147501568:12345-0@lo:901: Request processed in 114us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651758.326616:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788651758.327197:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788651758.327262:0:9522:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeb52680 x1875537147501568/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788651774 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651758.327275:0:9522:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9522:1875537147501568:0@lo:901: 00010000:00010000:2.0:1788651758.334033:0:9521:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1788651758.334480:0:9521:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788651758.334524:0:9521:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788651758.334536:0:9521:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcd2f56ea038c3b0c 00000100:00080000:2.0:1788651758.334546:0:9521:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788651758.334552:0:9521:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f85c32ce000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788651758.334585:0:9521:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86eeaefb80 x1875537147501696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788651758.334621:0:9521:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788651758.334689:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875537147501696:0@lo:38: 00000100:00100000:0.0:1788651758.334771:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.335190:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147501696 00000100:00100000:2.0:1788651758.335197:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147501696 00000100:00100000:2.0:1788651758.335237:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788651758.335244:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875537147501696:12345-0@lo:38: 00010000:00080000:2.0:1788651758.335278:0:6511:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:2.0:1788651758.335312:0:6511:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcd2f56ea038c3b13 00000004:00100000:2.0:1788651758.335328:0:6511:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788651758.335370:0:6511:0:(import.c:65:import_set_state_nolock()) ffff8f85c32cc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788651758.335426:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875537147501696:12345-0@lo:38: Request processed in 181us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.335434:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788651758.335475:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86eeaefb80 x1875537147501696/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788651768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651758.335486:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788651758.335493:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788651758.335500:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788651758.335505:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788651758.335507:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c32ce000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788651758.335512:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875537147501696:0@lo:38: 00000040:00080000:2.0:1788651758.335610:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:2.0:1788651758.338411:0:9504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:2.0:1788651758.338463:0:9504:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788651758.338494:0:9504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.338506:0:9504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788651758.338569:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788651758.338572:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788651758.338573:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788651758.338581:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788651758.338582:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788651758.338583:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788651758.338584:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788651758.338586:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788651758.338587:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788651758.338589:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788651758.338590:0:9504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788651758.338594:0:9504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788651758.338596:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788651758.338597:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788651758.338598:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788651758.338599:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788651758.338600:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788651758.338601:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788651758.338602:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788651758.338603:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788651758.338604:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788651758.338605:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788651758.338606:0:9504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788651758.338633:0:9504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788651758.338652:0:9504:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147501824:0@lo:253: 00000100:00100000:2.0:1788651758.338718:0:9504:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.338769:0:9504:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6437e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651758.338792:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147501824 00000100:00100000:2.0:1788651758.338799:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147501824 00000100:00100000:2.0:1788651758.338856:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788651758.338864:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9504:x1875537147501824:12345-0@lo:253: 20000000:01000000:2.0:1788651758.338889:0:6505:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788651758.338903:0:6505:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788651758.350432:0:6505:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788651758.350450:0:6505:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788651758.350605:0:6525:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788651758.350611:0:6525:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788651758.350634:0:6525:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.350661:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f8800/0xcd2f56ea038c3a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a09 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.350668:0:6525:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c3a56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3a4f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.350675:0:6525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.350715:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c3a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3a4f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.350728:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c3a56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a4f expref: 17 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.350743:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147501952:0@lo:104: 00000100:00100000:3.0:1788651758.350819:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651758.350874:0:6525:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f8800/0xcd2f56ea038c3a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3a09 expref: 17 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651758.350883:0:6525:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f87021f8800/0xcd2f56ea038c3a10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a09 expref: 17 pid: 6504 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.350891:0:6525:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147502080:0@lo:104: 00000100:00100000:3.0:1788651758.350935:0:6525:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.350951:0:6525:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12180 going to sleep for 11 seconds 00000100:00100000:2.0:1788651758.351389:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9504:x1875537147501824:12345-0@lo:253: Request processed in 12523us (12668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.351400:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788651758.351449:0:9515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147501952 00000100:00100000:2.0:1788651758.351467:0:9515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147501952 00000100:00100000:2.0:1788651758.351512:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147502080 00000100:00100000:2.0:1788651758.351516:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147502080 00000100:00100000:2.0:1788651758.351534:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788651758.351542:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6525:x1875537147501952:12345-0@lo:104: 00010000:00010000:2.0:1788651758.351555:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351604:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788651758.351609:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:6525:x1875537147501952:12345-0@lo:104: Request processed in 69us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.351615:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788651758.351627:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788651758.351633:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6525:x1875537147502080:12345-0@lo:104: 00010000:00010000:2.0:1788651758.351640:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351670:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788651758.351675:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:6525:x1875537147502080:12345-0@lo:104: Request processed in 44us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.351680:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1788651758.351694:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788651758.351699:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351706:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651758.351710:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351728:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651758.351735:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651758.351741:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651758.351790:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351797:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651758.351815:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351823:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3a4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a56 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351836:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651758.351839:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351844:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651758.351846:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351853:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651758.351859:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651758.351869:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651758.351883:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351889:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651758.351894:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351900:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c3a09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3a10 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.351936:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651758.351938:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651758.351940:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651758.352053:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147501952:0@lo:104: 00000100:00100000:3.0:1788651758.352596:0:6525:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6525:1875537147502080:0@lo:104: 00010000:00010000:3.0:1788651758.352629:0:6525:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651758.352683:0:9504:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9504:1875537147501824:0@lo:253: 10000000:01000000:3.0:1788651758.352692:0:9504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788651758.352696:0:9504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788651758.352697:0:9504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788651758.352699:0:9504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788651758.352700:0:9504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788651758.352701:0:9504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788651758.352702:0:9504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788651758.352704:0:9504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788651758.352705:0:9504:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788651758.352707:0:9504:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788651758.352708:0:9504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788651758.352710:0:9504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788651758.352722:0:9504:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788651758.359260:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147502208:0@lo:103: 00000100:00100000:2.0:1788651758.359342:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651758.359397:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651758.359404:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147502336:0@lo:103: 00000100:00100000:2.0:1788651758.359426:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788651758.359485:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651758.360024:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147502208 00000100:00100000:2.0:1788651758.360033:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147502208 00000100:00100000:1.0:1788651758.360704:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147502336 00000100:00100000:1.0:1788651758.360710:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147502336 00010000:00010000:1.0:1788651758.360738:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f8800/0xcd2f56ea038c3a10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a09 expref: 18 pid: 6504 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651758.360788:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788651758.360813:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:3637:x1875537147502336:12345-0@lo:103: 00010000:00010000:1.0:1788651758.360828:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651758.360835:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f8800/0xcd2f56ea038c3a10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a09 expref: 18 pid: 6504 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.360847:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f8800/0xcd2f56ea038c3a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a09 expref: 18 pid: 6504 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.360865:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f8800/0xcd2f56ea038c3a10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3a09 expref: 18 pid: 6504 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651758.360883:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651758.360961:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:3637:x1875537147502336:12345-0@lo:103: Request processed in 150us (1534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651758.360968:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788651758.361198:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c3a56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a4f expref: 16 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651758.361236:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788651758.361244:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:3637:x1875537147502208:12345-0@lo:103: 00010000:00010000:2.0:1788651758.361253:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651758.361263:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c3a56 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a4f expref: 16 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.361273:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c3a56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3a4f expref: 16 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.361284:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c3a56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3a4f expref: 16 pid: 6505 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.361295:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.361304:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788651758.361320:0:6496:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.017185986s 00010000:00010000:2.0:1788651758.361325:0:6496:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.361332:0:6496:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.361339:0:6496:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.361347:0:6496:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.361353:0:6496:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788651758.361357:0:6496:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.361365:0:6496:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.361388:0:6496:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.361398:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651758.361428:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:3637:x1875537147502208:12345-0@lo:103: Request processed in 186us (2086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651758.361435:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788651758.361476:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147502336:0@lo:103: 00000100:00100000:2.0:1788651758.361486:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147502208:0@lo:103: 00010000:00010000:2.0:1788651758.362036:0:6525:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.362047:0:6525:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651758.362053:0:6525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b1a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6525 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788651758.365509:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1788651758.365659:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788651758.370446:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:3.0:1788651758.371251:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788651758.371456:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:3.0:1788651758.371651:0:9504:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:3.0:1788651758.379736:0:9504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788651758.411148:0:9504:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788651758.411160:0:9504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788651758.411199:0:9504:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788651758.411246:0:9504:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788651758.411263:0:9504:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788651758.411293:0:9504:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788651758.412487:0:9504:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788651758.413441:0:9504:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:2.0:1788651758.560966:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651758.560996:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147502464:0@lo:41: 00000100:00100000:2.0:1788651758.561081:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651758.565335:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147502464 00000100:00100000:3.0:1788651758.565356:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147502464 00000100:00100000:3.0:1788651758.566258:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788651758.566273:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147502464:12345-0@lo:41: 00000004:00000024:3.0:1788651758.566313:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:3.0:1788651758.566390:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147502464:12345-0@lo:41: Request processed in 123us (5311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651758.566397:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788651758.571415:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147502464:0@lo:41: 00010000:00010000:3.0:1788651759.074591:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788651759.533626:0:9577:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788651759.533881:0:9577:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788651760.103320:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651761.120367:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651761.120567:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651761.120593:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147502592:0@lo:13: 00000100:00100000:2.0:1788651761.120663:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651761.120730:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147502592 00000100:00100000:1.0:1788651761.120739:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147502592 00000100:00080000:2.0:1788651761.120762:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651761.120801:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788651761.120811:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147502592:12345-0@lo:13: 00002000:00000024:1.0:1788651761.120851:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651761.120923:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147502592:12345-0@lo:13: Request processed in 98us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651761.120930:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788651761.120947:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeaec000 x1875537147502592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651761.120981:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147502592:0@lo:13: 00000100:00100000:3.0:1788651761.121581:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651761.121595:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147502720:0@lo:13: 00000100:00100000:3.0:1788651761.121633:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651761.121805:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147502720 00000100:00100000:0.0:1788651761.121811:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147502720 00000100:00080000:3.0:1788651761.121870:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651761.121871:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788651761.121882:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147502720:12345-0@lo:13: 00002000:00000024:0.0:1788651761.121898:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651761.121975:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147502720:12345-0@lo:13: Request processed in 94us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651761.121982:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788651761.122023:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c23aea00 x1875537147502720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651761.122037:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147502720:0@lo:13: 00010000:00010000:0.0:1788651762.146819:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651762.147252:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147502848:0@lo:41: 00000100:00100000:1.0:1788651762.147325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651762.148129:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147502848 00000100:00100000:2.0:1788651762.148140:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147502848 00000100:00100000:2.0:1788651762.148190:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788651762.148199:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147502848:12345-0@lo:41: 00000004:00000024:2.0:1788651762.148236:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788651762.148302:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147502848:12345-0@lo:41: Request processed in 103us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651762.148309:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788651762.148382:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147502848:0@lo:41: 00010000:00010000:1.0:1788651763.168199:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651763.681624:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651763.681659:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147502976:0@lo:41: 00000100:00100000:0.0:1788651763.681736:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651763.681812:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147502976 00000100:00100000:0.0:1788651763.681820:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147502976 00000100:00100000:0.0:1788651763.681866:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788651763.681874:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147502976:12345-0@lo:41: 00000004:00000024:0.0:1788651763.681925:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788651763.681977:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147502976:12345-0@lo:41: Request processed in 103us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651763.681984:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788651763.682035:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147502976:0@lo:41: 00000100:00100000:1.0:1788651763.682727:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147503360:0@lo:400: 00000100:00100000:1.0:1788651763.682765:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651763.682797:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147503872:0@lo:400: 00000100:00100000:1.0:1788651763.682819:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651763.682846:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788651763.682852:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147503232:0@lo:400: 00000100:00100000:1.0:1788651763.682872:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651763.682886:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147503744:0@lo:400: 00000100:00100000:1.0:1788651763.682905:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651763.682945:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147504256:0@lo:400: 00000100:00100000:1.0:1788651763.682967:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651763.682988:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147503360 00000100:00100000:1.0:1788651763.682992:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147503360 00000100:00100000:1.0:1788651763.683017:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147503232 00000100:00100000:1.0:1788651763.683020:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147503232 00000100:00100000:1.0:1788651763.683031:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147503744 00000100:00100000:1.0:1788651763.683033:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147503744 00000100:00100000:1.0:1788651763.683055:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147504256 00000100:00100000:1.0:1788651763.683058:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147504256 00000100:00100000:1.0:1788651763.683070:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788651763.683075:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147503360:12345-0@lo:400: 00000100:00100000:1.0:1788651763.683129:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147503360:12345-0@lo:400: Request processed in 53us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651763.683136:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788651763.683149:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788651763.683155:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147503232:12345-0@lo:400: 00000100:00100000:1.0:1788651763.683179:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147503232:12345-0@lo:400: Request processed in 24us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651763.683184:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788651763.683194:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788651763.683206:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147503744:12345-0@lo:400: 00000100:00100000:1.0:1788651763.683234:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147503744:12345-0@lo:400: Request processed in 30us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651763.683240:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788651763.683251:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788651763.683256:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147504256:12345-0@lo:400: 00000100:00100000:1.0:1788651763.683279:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147504256:12345-0@lo:400: Request processed in 23us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651763.683284:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788651763.683301:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147503872 00000100:00100000:1.0:1788651763.683304:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147503872 00000100:00100000:1.0:1788651763.683330:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788651763.683336:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147503872:12345-0@lo:400: 00000100:00100000:1.0:1788651763.683378:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147503872:12345-0@lo:400: Request processed in 43us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651763.683385:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788651763.683401:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651763.683404:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651763.683416:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147503104:0@lo:400: 00000100:00100000:1.0:1788651763.683441:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651763.683470:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147503616:0@lo:400: 00000100:00100000:1.0:1788651763.683500:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651763.683518:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147504128:0@lo:400: 00000100:00100000:1.0:1788651763.683542:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651763.683554:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788651763.683559:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147503488:0@lo:400: 00000100:00100000:1.0:1788651763.683589:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651763.683605:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147504000:0@lo:400: 00000100:00100000:1.0:1788651763.683624:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651763.683659:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147504000 00000100:00100000:1.0:1788651763.683663:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147504000 00000100:00100000:1.0:1788651763.683691:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788651763.683697:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147504000:12345-0@lo:400: 00000100:00100000:1.0:1788651763.683729:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147504000:12345-0@lo:400: Request processed in 32us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651763.683735:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788651763.683750:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788651763.683770:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d109bb80 x1875537147503232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651763.683782:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147503232:0@lo:400: 00010000:00080000:1.0:1788651763.683791:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d1099c00 x1875537147503744/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651763.683799:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147503744:0@lo:400: 00010000:00080000:1.0:1788651763.683806:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d109b800 x1875537147504256/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651763.683813:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147504256:0@lo:400: 00010000:00080000:1.0:1788651763.683822:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d1098380 x1875537147503360/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651763.683828:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147503360:0@lo:400: 00010000:00080000:1.0:1788651763.683836:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d109a680 x1875537147503872/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651763.683849:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147503872:0@lo:400: 00000100:00100000:1.0:1788651763.683874:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147503616 00000100:00100000:1.0:1788651763.683877:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147503616 00000100:00100000:1.0:1788651763.683896:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147504128 00000100:00100000:1.0:1788651763.683898:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147504128 00000100:00100000:1.0:1788651763.683932:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788651763.683938:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147503616:12345-0@lo:400: 00000100:00100000:1.0:1788651763.683964:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147503616:12345-0@lo:400: Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651763.683969:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788651763.683979:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788651763.683984:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147504128:12345-0@lo:400: 00000100:00100000:1.0:1788651763.684005:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147504128:12345-0@lo:400: Request processed in 22us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651763.684010:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1788651763.684021:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788651763.684034:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d109b100 x1875537147504000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651763.684042:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147504000:0@lo:400: 00010000:00080000:1.0:1788651763.684050:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d1098a80 x1875537147503616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651763.684056:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147503616:0@lo:400: 00010000:00080000:1.0:1788651763.684064:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d1099500 x1875537147504128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651763.684081:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147504128:0@lo:400: 00000100:00100000:3.0:1788651763.684596:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147503104 00000100:00100000:3.0:1788651763.684602:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147503104 00000100:00100000:3.0:1788651763.684638:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788651763.684656:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:3636:x1875537147503104:12345-0@lo:400: 00000100:00100000:3.0:1788651763.684699:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:3636:x1875537147503104:12345-0@lo:400: Request processed in 54us (1256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651763.684706:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788651763.686066:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147503488 00000100:00100000:2.0:1788651763.686078:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147503488 00000100:00100000:2.0:1788651763.686137:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788651763.686146:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147503488:12345-0@lo:400: 00000100:00100000:2.0:1788651763.686209:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147503488:12345-0@lo:400: Request processed in 65us (2619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651763.686217:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788651763.689570:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147503488:0@lo:400: 00000100:00100000:1.0:1788651763.689590:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147503104:0@lo:400: 00010000:00010000:3.0:1788651764.193684:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788651764.704763:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788651764.704772:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86eeab9800 from 39 10000000:01000000:1.0:1788651764.704777:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788651764.704823:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651764.704835:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651764.704846:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651764.704871:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147504384:0@lo:101: 00000100:00100000:1.0:1788651764.704957:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651764.705004:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ee240 going to sleep for 11 seconds 00000100:00100000:1.0:1788651764.705045:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147504384 00000100:00100000:1.0:1788651764.705052:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147504384 00000100:00100000:1.0:1788651764.705100:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788651764.705110:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147504384:12345-0@lo:101: 00010000:00010000:1.0:1788651764.705122:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651764.705135:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3b21 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651764.705162:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b21 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651764.705183:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b21 expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651764.705192:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415400, rc 0) 00000100:00100000:1.0:1788651764.705235:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147504384:12345-0@lo:101: Request processed in 127us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651764.705242:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788651764.705285:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147504384:0@lo:101: 00010000:00010000:1.0:1788651764.705299:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651764.705308:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651764.705375:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147504512:0@lo:501: 00000100:00100000:1.0:1788651764.705399:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651764.705414:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ee240 going to sleep for 11 seconds 00000100:00100000:1.0:1788651764.705426:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147504512 00000100:00100000:1.0:1788651764.705430:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147504512 00000100:00100000:1.0:1788651764.708552:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788651764.708576:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147504512:12345-0@lo:501: 00000100:00100000:1.0:1788651764.709983:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147504512:12345-0@lo:501: Request processed in 1412us (4575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651764.709996:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788651764.726492:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147504512:0@lo:501: 00000100:00100000:1.0:1788651764.726550:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147504640:0@lo:503: 00000100:00100000:1.0:1788651764.726646:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651764.726693:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ee240 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.727073:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147504640 00000100:00100000:0.0:1788651764.727080:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147504640 00000100:00100000:0.0:1788651764.727128:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788651764.727138:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147504640:12345-0@lo:503: 00000100:00100000:0.0:1788651764.727256:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147504640:12345-0@lo:503: Request processed in 119us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.727263:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788651764.727309:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a51880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147504640:0@lo:503: 00000100:00100000:0.0:1788651764.727505:0:9826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9826:1875537147504768:0@lo:502: 00000100:00100000:0.0:1788651764.727537:0:9826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.727555:0:9826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651764.729643:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147504768 00000100:00100000:1.0:1788651764.729657:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147504768 00000100:00100000:1.0:1788651764.729722:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788651764.729732:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9826:x1875537147504768:12345-0@lo:502: 00000100:00100000:1.0:1788651764.729893:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9826:x1875537147504768:12345-0@lo:502: Request processed in 162us (2354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651764.729902:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788651764.732933:0:9826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9826:1875537147504768:0@lo:502: 00000100:00100000:0.0:1788651764.733018:0:9826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9826:1875537147504896:0@lo:502: 00000100:00100000:0.0:1788651764.733087:0:9826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.733130:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147504896 00000100:00100000:0.0:1788651764.733143:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147504896 00000100:00100000:0.0:1788651764.733189:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788651764.733198:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9826:x1875537147504896:12345-0@lo:502: 00000100:00100000:0.0:1788651764.733315:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:9826:x1875537147504896:12345-0@lo:502: Request processed in 117us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.733322:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788651764.733372:0:9826:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.733384:0:9826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9826:1875537147504896:0@lo:502: 00000040:00080000:0.0:1788651764.733415:0:9826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788651764.733597:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788651764.733636:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788651764.733645:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.733657:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651764.733666:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788651764.733669:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788651764.733672:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788651764.733698:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.733707:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.733716:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651764.733728:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505024:0@lo:101: 00000100:00100000:0.0:1788651764.733764:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.733778:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.733791:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147505024 00000100:00100000:0.0:1788651764.733795:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147505024 00000100:00100000:0.0:1788651764.733820:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788651764.733828:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147505024:12345-0@lo:101: 00010000:00010000:0.0:1788651764.733837:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651764.733850:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3b36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3b2f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.733872:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b2f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.733882:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b2f expref: 17 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.733892:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4a00, rc 0) 00000100:00100000:0.0:1788651764.733954:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147505024:12345-0@lo:101: Request processed in 127us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.733960:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788651764.733993:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505024:0@lo:101: 00010000:00010000:0.0:1788651764.734004:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.734013:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651764.734056:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505152:0@lo:501: 00000100:00100000:0.0:1788651764.734090:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.734108:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.734119:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147505152 00000100:00100000:0.0:1788651764.734122:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147505152 00000100:00100000:0.0:1788651764.734144:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788651764.734150:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147505152:12345-0@lo:501: 00000100:00100000:0.0:1788651764.734250:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147505152:12345-0@lo:501: Request processed in 99us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.734256:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788651764.734285:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505152:0@lo:501: 00000100:00100000:0.0:1788651764.734308:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505280:0@lo:503: 00000100:00100000:0.0:1788651764.734340:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.734354:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.734364:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147505280 00000100:00100000:0.0:1788651764.734367:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147505280 00000100:00100000:0.0:1788651764.734388:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788651764.734411:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147505280:12345-0@lo:503: 00000100:00100000:0.0:1788651764.737006:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147505280:12345-0@lo:503: Request processed in 2589us (2658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.737020:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788651764.738819:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505280:0@lo:503: 00000100:00100000:3.0:1788651764.742741:0:9830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9830:1875537147505408:0@lo:502: 00000100:00100000:3.0:1788651764.742828:0:9830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.742874:0:9830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fa000 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.743010:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147505408 00000100:00100000:0.0:1788651764.743020:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147505408 00000100:00100000:0.0:1788651764.743069:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788651764.743078:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9830:x1875537147505408:12345-0@lo:502: 00000100:00100000:0.0:1788651764.743201:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9830:x1875537147505408:12345-0@lo:502: Request processed in 124us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.743216:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788651764.745164:0:9830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9830:1875537147505408:0@lo:502: 00000020:01000000:3.0:1788651764.745210:0:9830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651764.745221:0:9830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651764.745224:0:9830:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788651764.745229:0:9830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788651764.745231:0:9830:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788651764.745263:0:9830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9830:1875537147505536:0@lo:502: 00000100:00100000:3.0:1788651764.745330:0:9830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.754315:0:9830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fa000 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.756575:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147505536 00000100:00100000:0.0:1788651764.756589:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147505536 00000100:00100000:0.0:1788651764.756810:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788651764.756822:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9830:x1875537147505536:12345-0@lo:502: 00000100:00100000:0.0:1788651764.757047:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:9830:x1875537147505536:12345-0@lo:502: Request processed in 226us (11714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.757055:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788651764.757569:0:9830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9830:1875537147505536:0@lo:502: 00000020:01000000:3.0:1788651764.757618:0:9830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651764.757635:0:9830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651764.757638:0:9830:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788651764.757642:0:9830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788651764.768664:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788651764.768703:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788651764.768715:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.768727:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651764.768738:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788651764.768741:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86f48d9800 from 39 10000000:01000000:0.0:1788651764.768744:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788651764.768788:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.768797:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.768808:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651764.768835:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505664:0@lo:101: 00000100:00100000:0.0:1788651764.769121:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.769165:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651764.769533:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147505664 00000100:00100000:3.0:1788651764.769542:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147505664 00000100:00100000:3.0:1788651764.769600:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788651764.769609:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147505664:12345-0@lo:101: 00010000:00010000:3.0:1788651764.769632:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651764.769647:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3b3d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651764.769670:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b3d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651764.769681:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b3d expref: 18 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651764.769705:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1503200, rc 0) 00000100:00100000:3.0:1788651764.769753:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147505664:12345-0@lo:101: Request processed in 145us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651764.769760:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788651764.769809:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505664:0@lo:101: 00010000:00010000:3.0:1788651764.769825:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651764.769834:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651764.769896:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505792:0@lo:501: 00000100:00100000:3.0:1788651764.769950:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.769963:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fa780 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.770645:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147505792 00000100:00100000:0.0:1788651764.770653:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147505792 00000100:00100000:0.0:1788651764.770697:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788651764.770706:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147505792:12345-0@lo:501: 00000100:00100000:0.0:1788651764.770845:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147505792:12345-0@lo:501: Request processed in 140us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.770852:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788651764.770961:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505792:0@lo:501: 00000100:00100000:3.0:1788651764.770999:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505920:0@lo:503: 00000100:00100000:3.0:1788651764.771045:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.771069:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fa780 going to sleep for 11 seconds 00000100:00100000:3.0:1788651764.771085:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147505920 00000100:00100000:3.0:1788651764.771088:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147505920 00000100:00100000:3.0:1788651764.771111:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788651764.771118:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147505920:12345-0@lo:503: 00000100:00100000:3.0:1788651764.771199:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147505920:12345-0@lo:503: Request processed in 81us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651764.771206:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788651764.771252:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147505920:0@lo:503: 00000100:00100000:1.0:1788651764.776016:0:9831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9831:1875537147506048:0@lo:502: 00000100:00100000:1.0:1788651764.776113:0:9831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651764.776160:0:9831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc1dc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.776270:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147506048 00000100:00100000:0.0:1788651764.776278:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147506048 00000100:00100000:0.0:1788651764.776328:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788651764.776337:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:9831:x1875537147506048:12345-0@lo:502: 00000100:00100000:0.0:1788651764.776467:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:9831:x1875537147506048:12345-0@lo:502: Request processed in 130us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.776476:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788651764.777713:0:9831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9831:1875537147506048:0@lo:502: 00000100:00100000:1.0:1788651764.777791:0:9831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9831:1875537147506176:0@lo:502: 00000100:00100000:1.0:1788651764.777857:0:9831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651764.777895:0:9831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3926780 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.778590:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147506176 00000100:00100000:0.0:1788651764.778601:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147506176 00000100:00100000:0.0:1788651764.778663:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788651764.778673:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:9831:x1875537147506176:12345-0@lo:502: 00000100:00100000:0.0:1788651764.778808:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:9831:x1875537147506176:12345-0@lo:502: Request processed in 136us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.778817:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788651764.779010:0:9831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a52a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9831:1875537147506176:0@lo:502: 00000040:00080000:1.0:1788651764.779040:0:9831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788651764.779552:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788651764.779577:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788651764.779588:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.779615:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651764.779634:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788651764.779637:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86f48d9800 from 6 10000000:01000000:0.0:1788651764.779640:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788651764.779676:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.779684:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.779694:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651764.779713:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147506304:0@lo:101: 00000100:00100000:0.0:1788651764.779755:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.779783:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651764.779896:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147506304 00000100:00100000:1.0:1788651764.779904:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147506304 00000100:00100000:1.0:1788651764.779969:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788651764.779976:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147506304:12345-0@lo:101: 00010000:00010000:1.0:1788651764.779989:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651764.780003:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff414200/0xcd2f56ea038c3b52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3b4b expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651764.780039:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414200/0xcd2f56ea038c3b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b4b expref: 19 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651764.780051:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff414200/0xcd2f56ea038c3b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b4b expref: 19 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651764.780059:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414200, rc 0) 00000100:00100000:1.0:1788651764.780108:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147506304:12345-0@lo:101: Request processed in 132us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651764.780114:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788651764.780199:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147506304:0@lo:101: 00010000:00010000:2.0:1788651764.780213:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.780222:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651764.780271:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147506432:0@lo:256: 00000100:00100000:2.0:1788651764.780304:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.780341:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c326f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788651764.780545:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147506432 00000100:00100000:1.0:1788651764.780550:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147506432 00000100:00100000:1.0:1788651764.780586:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788651764.780594:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147506432:12345-0@lo:256: 20000000:01000000:1.0:1788651764.780608:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788651764.780633:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788651764.780637:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788651764.780709:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147506432:12345-0@lo:256: Request processed in 115us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651764.780716:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788651764.780790:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147506432:0@lo:256: 10000000:01000000:2.0:1788651764.780836:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788651764.780843:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.780851:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651764.780858:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1788651764.780860:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1788651764.780862:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1788651764.780880:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.780887:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.780895:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651764.780943:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147506560:0@lo:101: 00000100:00100000:2.0:1788651764.780971:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.780987:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.781062:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147506560 00000100:00100000:0.0:1788651764.781066:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147506560 00000100:00100000:0.0:1788651764.781092:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788651764.781099:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147506560:12345-0@lo:101: 00010000:00010000:0.0:1788651764.781107:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651764.781119:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3b60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3b59 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.781134:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b59 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.781156:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b59 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.781163:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4400, rc 0) 00000100:00100000:0.0:1788651764.781192:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147506560:12345-0@lo:101: Request processed in 93us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.781198:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788651764.781559:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147506560:0@lo:101: 00010000:00010000:2.0:1788651764.781570:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.781578:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651764.781653:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147506688:0@lo:501: 00000100:00100000:2.0:1788651764.781683:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.781715:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.782102:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147506688 00000100:00100000:0.0:1788651764.782108:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147506688 00000100:00100000:0.0:1788651764.782145:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788651764.782152:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147506688:12345-0@lo:501: 00000100:00100000:0.0:1788651764.782267:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147506688:12345-0@lo:501: Request processed in 115us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.782275:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788651764.782351:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147506688:0@lo:501: 00000100:00100000:2.0:1788651764.782378:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147506816:0@lo:503: 00000100:00100000:2.0:1788651764.782430:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.782465:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.782577:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147506816 00000100:00100000:0.0:1788651764.782581:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147506816 00000100:00100000:0.0:1788651764.782615:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788651764.782621:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147506816:12345-0@lo:503: 00000100:00100000:0.0:1788651764.782709:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147506816:12345-0@lo:503: Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.782716:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788651764.782797:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147506816:0@lo:503: 00000100:00100000:2.0:1788651764.787968:0:9832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9832:1875537147506944:0@lo:502: 00000100:00100000:2.0:1788651764.788055:0:9832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.788104:0:9832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.790581:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147506944 00000100:00100000:0.0:1788651764.790596:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147506944 00000100:00100000:0.0:1788651764.790661:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788651764.790672:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:9832:x1875537147506944:12345-0@lo:502: 00000100:00100000:0.0:1788651764.790849:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:9832:x1875537147506944:12345-0@lo:502: Request processed in 177us (2793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.790863:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788651764.791456:0:9832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9832:1875537147506944:0@lo:502: 00000020:01000000:2.0:1788651764.791495:0:9832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788651764.791503:0:9832:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788651764.791510:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651764.791513:0:9832:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788651764.791518:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788651764.791522:0:9832:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:01000000:2.0:1788651764.791545:0:9832:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788651764.791548:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788651764.791563:0:9832:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f85c2934d40) 00000020:00000080:2.0:1788651764.791586:0:9832:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1788651764.791590:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788651764.791689:0:9832:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788651764.791696:0:9832:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788651764.791709:0:9832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c3b6e 00010000:00080000:2.0:1788651764.791737:0:9832:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c19f6800@lustre-OST0001-osc-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788651764.791974:0:9832:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1788651764.792101:0:9832:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1788651764.792113:0:9832:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788651764.792320:0:9832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651764.792429:0:9832:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651764.792559:0:9832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788651764.792672:0:9832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788651764.796756:0:9833:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651764.796764:0:9833:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788651764.801936:0:9832:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788651764.801952:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788651764.801996:0:9832:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788651764.802021:0:9832:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c3b75 00000100:00080000:3.0:1788651764.802033:0:9832:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788651764.802039:0:9832:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f85c19f6800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788651764.802077:0:9832:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86eeb52680 x1875537147507072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788651764.802104:0:9832:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788651764.802164:0:9832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651764.802168:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651764.802170:0:9832:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788651764.802173:0:9832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651764.802176:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651764.802178:0:9832:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788651764.802180:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788651764.802182:0:9832:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788651764.802209:0:9832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9832:1875537147507200:0@lo:502: 00000100:00100000:3.0:1788651764.802287:0:9832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.802324:0:9832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fb18b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788651764.802579:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147507072:0@lo:8: 00000100:00100000:2.0:1788651764.802619:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.802670:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651764.802678:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147507328:0@lo:400: 00000100:00100000:2.0:1788651764.802706:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.802733:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147507456:0@lo:400: 00000100:00100000:2.0:1788651764.802758:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.802777:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651764.802783:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147507584:0@lo:400: 00000100:00100000:2.0:1788651764.802816:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.802849:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147507072 00000100:00100000:2.0:1788651764.802856:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147507072 00000100:00100000:2.0:1788651764.802889:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788651764.802896:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1875537147507072:12345-0@lo:8: 00010000:00080000:2.0:1788651764.802959:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1788651764.802988:0:8428:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c3b7c 00002000:00100000:2.0:1788651764.803002:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f85c354b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788651764.803007:0:8428:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788651764.803011:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788651764.803082:0:8428:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788651764.803291:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788651764.803316:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8f85c354f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788651764.803372:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1875537147507072:12345-0@lo:8: Request processed in 473us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.803379:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788651764.803420:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147507328 00000100:00100000:2.0:1788651764.803425:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147507328 00000100:00100000:3.0:1788651764.803763:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147507200 00000100:00100000:3.0:1788651764.803768:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147507200 00000100:00100000:3.0:1788651764.803796:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788651764.803803:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:9832:x1875537147507200:12345-0@lo:502: 00000100:00100000:3.0:1788651764.803927:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:9832:x1875537147507200:12345-0@lo:502: Request processed in 124us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651764.803944:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788651764.803986:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147507840:0@lo:400: 00000100:00100000:3.0:1788651764.804014:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.804034:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147508352:0@lo:400: 00000100:00100000:3.0:1788651764.804053:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.804064:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788651764.804068:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147507712:0@lo:400: 00000100:00100000:3.0:1788651764.804088:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.804103:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147508224:0@lo:400: 00000100:00100000:3.0:1788651764.804121:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.804145:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147508096:0@lo:400: 00000100:00100000:3.0:1788651764.804165:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.804180:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788651764.804185:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147507968:0@lo:400: 00000100:00100000:3.0:1788651764.804202:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.804210:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147508480:0@lo:400: 00000100:00100000:3.0:1788651764.804227:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.804259:0:9832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9832:1875537147507200:0@lo:502: 00000020:01000000:3.0:1788651764.804288:0:9832:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651764.804294:0:9832:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651764.804296:0:9832:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788651764.804301:0:9832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000100:00100000:3.0:1788651764.804437:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147508224 00000100:00100000:2.0:1788651764.806102:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147507584 00000100:00100000:2.0:1788651764.806113:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147507584 00000100:00100000:2.0:1788651764.806141:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147507840 00000100:00100000:2.0:1788651764.806144:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147507840 00000100:00100000:2.0:1788651764.806155:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147508352 00000100:00100000:2.0:1788651764.806158:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147508352 00000100:00100000:2.0:1788651764.806168:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147507968 00000100:00100000:2.0:1788651764.806171:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147507968 00000100:00100000:2.0:1788651764.806183:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147508480 00000100:00100000:2.0:1788651764.806185:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147508480 00000100:00100000:2.0:1788651764.806199:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788651764.806208:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147507328:12345-0@lo:400: 00000100:00100000:2.0:1788651764.806281:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147507328:12345-0@lo:400: Request processed in 74us (3573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.806288:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788651764.806306:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788651764.806312:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147507584:12345-0@lo:400: 00000100:00100000:2.0:1788651764.806341:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147507584:12345-0@lo:400: Request processed in 29us (3524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.806346:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788651764.806357:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788651764.806363:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147507840:12345-0@lo:400: 00000100:00100000:3.0:1788651764.807757:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147508224 00000100:00100000:3.0:1788651764.807832:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147508096 00000100:00100000:3.0:1788651764.807836:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147508096 00000100:00100000:3.0:1788651764.807866:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788651764.807873:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147508224:12345-0@lo:400: 00000100:00100000:0.0:1788651764.808009:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788651764.808021:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147508096:12345-0@lo:400: 00000100:00100000:3.0:1788651764.808103:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147508224:12345-0@lo:400: Request processed in 230us (3979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651764.808110:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788651764.808158:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2832680 x1875537147508224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651764.808173:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147508224:0@lo:400: 00000100:00100000:2.0:1788651764.808316:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2830a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147507840:12345-0@lo:400: Request processed in 1952us (4299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.808325:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788651764.808345:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788651764.808353:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147508352:12345-0@lo:400: 00000100:00100000:2.0:1788651764.808385:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147508352:12345-0@lo:400: Request processed in 34us (4330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.808406:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788651764.808421:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788651764.808428:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147507968:12345-0@lo:400: 00000100:00100000:2.0:1788651764.808492:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147507968:12345-0@lo:400: Request processed in 65us (4288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.808498:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788651764.808511:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788651764.808518:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147508480:12345-0@lo:400: 00000100:00100000:2.0:1788651764.808547:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147508480:12345-0@lo:400: Request processed in 30us (4318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.808553:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788651764.808573:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147507456 00000100:00100000:2.0:1788651764.808578:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147507456 00000100:00100000:2.0:1788651764.808604:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147507712 00000100:00100000:2.0:1788651764.808607:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147507712 00000100:00100000:2.0:1788651764.808632:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788651764.808639:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147507456:12345-0@lo:400: 00000100:00100000:2.0:1788651764.808671:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147507456:12345-0@lo:400: Request processed in 33us (5913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.808687:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788651764.808700:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788651764.808706:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147507712:12345-0@lo:400: 00000100:00100000:2.0:1788651764.808733:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147507712:12345-0@lo:400: Request processed in 27us (4644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.808739:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000020:01000000:2.0:1788651764.808769:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1788651764.808804:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788651764.808814:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.808825:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651764.808836:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788651764.808839:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86da667000 from 39 10000000:01000000:2.0:1788651764.808841:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788651764.808873:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.808881:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.808891:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651764.808937:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147508608:0@lo:101: 00000100:00100000:2.0:1788651764.808974:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.809011:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788651764.809027:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147508608 00000100:00100000:2.0:1788651764.809031:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147508608 00000100:00100000:2.0:1788651764.809054:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788651764.809060:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147508608:12345-0@lo:101: 00010000:00010000:2.0:1788651764.809068:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651764.809080:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dd800/0xcd2f56ea038c3b8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3b83 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.809101:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dd800/0xcd2f56ea038c3b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b83 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.809111:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dd800/0xcd2f56ea038c3b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b83 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.809120:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd800, rc 0) 00000100:00100000:2.0:1788651764.809150:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147508608:12345-0@lo:101: Request processed in 89us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.809155:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00080000:2.0:1788651764.809196:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d5c00 x1875537147507328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651764.809207:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147507328:0@lo:400: 00010000:00080000:2.0:1788651764.809239:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb52680 x1875537147507072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788651774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651764.809248:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788651764.809255:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788651764.809262:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788651764.809267:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788651764.809277:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788651764.809284:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788651764.809289:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147507072:0@lo:8: 00010000:00080000:2.0:1788651764.809322:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ea15c000 x1875537147507584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651764.809331:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147507584:0@lo:400: 00000100:00100000:2.0:1788651764.809342:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147507456:0@lo:400: 00000100:00100000:2.0:1788651764.809365:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147508608:0@lo:101: 00010000:00010000:2.0:1788651764.809377:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.809385:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651764.809445:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147508736:0@lo:501: 00000100:00100000:2.0:1788651764.809470:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.809485:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788651764.809512:0:9834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9834:1875537147508864:0@lo:700: 00000100:00100000:2.0:1788651764.809537:0:9834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.809553:0:9834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc83c0 going to sleep for 11 seconds 00010000:00080000:3.0:1788651764.813736:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2831500 x1875537147507840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651764.813757:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147507840:0@lo:400: 00010000:00080000:3.0:1788651764.813778:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2831c00 x1875537147508352/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651764.813787:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147508352:0@lo:400: 00000100:00100000:3.0:1788651764.813827:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147507712:0@lo:400: 00010000:00080000:3.0:1788651764.813870:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2833800 x1875537147507968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651764.813879:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2833800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147507968:0@lo:400: 00010000:00080000:3.0:1788651764.813892:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2830700 x1875537147508480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651764.813900:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147508480:0@lo:400: 00000100:00100000:3.0:1788651764.813950:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147508736 00000100:00100000:3.0:1788651764.813957:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147508736 00000100:00100000:3.0:1788651764.814023:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788651764.814031:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147508736:12345-0@lo:501: 00000100:00100000:3.0:1788651764.814206:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147508736:12345-0@lo:501: Request processed in 176us (4734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651764.814214:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788651764.814280:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147508736:0@lo:501: 00000100:00100000:3.0:1788651764.814328:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2830700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147508992:0@lo:503: 00000100:00100000:3.0:1788651764.814378:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.814420:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fb18b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788651764.814433:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147508992 00000100:00100000:3.0:1788651764.814437:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147508992 00000100:00100000:3.0:1788651764.814543:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788651764.814550:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147508992:12345-0@lo:503: 00000100:00100000:3.0:1788651764.814642:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147508992:12345-0@lo:503: Request processed in 93us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651764.814650:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788651764.814694:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2830700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147508992:0@lo:503: 00000004:00080000:3.0:1788651764.814832:0:9833:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788651764.814933:0:9833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 220749996326ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788651764.814941:0:9833:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788651764.821710:0:9835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9835:1875537147509120:0@lo:502: 00000100:00100000:2.0:1788651764.821799:0:9835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.821838:0:9835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.822273:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147509120 00000100:00100000:0.0:1788651764.822281:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147509120 00000100:00100000:0.0:1788651764.822330:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788651764.822341:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:9835:x1875537147509120:12345-0@lo:502: 00000100:00100000:0.0:1788651764.822496:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:9835:x1875537147509120:12345-0@lo:502: Request processed in 156us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.822504:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788651764.822552:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147508864 00000100:00100000:0.0:1788651764.822557:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147508864 00000100:00100000:0.0:1788651764.822597:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788651764.822605:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9834:x1875537147508864:12345-0@lo:700: 00000100:00100000:0.0:1788651764.822653:0:8436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23af480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1875537147509248:0@lo:700: 00000100:00100000:0.0:1788651764.822684:0:8436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.822703:0:8436:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc559c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788651764.822716:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651764.822731:0:6516:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147509248 00000100:00100000:0.0:1788651764.822736:0:6516:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147509248 00000100:00100000:0.0:1788651764.822763:0:6516:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788651764.822770:0:6516:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1875537147509248:12345-0@lo:700: 00000100:00100000:0.0:1788651764.822936:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2830000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147508096:12345-0@lo:400: Request processed in 14917us (18767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.822946:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788651764.822987:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2833100 x1875537147508096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651780 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651764.823010:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147508096:0@lo:400: 00000100:00100000:2.0:1788651764.829834:0:9835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9835:1875537147509120:0@lo:502: 00000100:00100000:2.0:1788651764.829970:0:9835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9835:1875537147509376:0@lo:502: 00000100:00100000:2.0:1788651764.830053:0:9835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.830102:0:9835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788651764.830384:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147509376 00000100:00100000:3.0:1788651764.830398:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147509376 00000100:00100000:3.0:1788651764.830455:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788651764.830465:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:9835:x1875537147509376:12345-0@lo:502: 00000100:00100000:3.0:1788651764.830595:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:9835:x1875537147509376:12345-0@lo:502: Request processed in 131us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651764.830613:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788651764.830827:0:9835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34af480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9835:1875537147509376:0@lo:502: 00000040:00080000:2.0:1788651764.830851:0:9835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1788651764.832122:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1788651764.832160:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788651764.832171:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651764.832183:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651764.832192:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788651764.832195:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86da667000 from 6 10000000:01000000:3.0:1788651764.832197:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788651764.832228:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651764.832236:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651764.832245:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651764.832263:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2830700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147509504:0@lo:101: 00000100:00100000:3.0:1788651764.832316:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.832349:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c30fa540 going to sleep for 11 seconds 00000100:00100000:2.0:1788651764.832474:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147509504 00000100:00100000:2.0:1788651764.832481:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147509504 00000100:00100000:2.0:1788651764.832526:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788651764.832535:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147509504:12345-0@lo:101: 00010000:00010000:2.0:1788651764.832548:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651764.832560:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c3b98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3b91 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.832582:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c3b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b91 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.832592:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c3b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b91 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.832601:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dce00, rc 0) 00000100:00100000:2.0:1788651764.832652:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147509504:12345-0@lo:101: Request processed in 118us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.832658:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788651764.832717:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2830700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147509504:0@lo:101: 00010000:00010000:2.0:1788651764.832729:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651764.832738:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651764.832818:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147509632:0@lo:256: 00000100:00100000:2.0:1788651764.832847:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.832864:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8d80 going to sleep for 11 seconds 00000004:00080000:2.0:1788651764.832954:0:7440:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788651764.833102:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147509632 00000100:00100000:0.0:1788651764.833108:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147509632 00000100:00100000:0.0:1788651764.833144:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788651764.833152:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147509632:12345-0@lo:256: 20000000:01000000:0.0:1788651764.833167:0:6505:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788651764.833182:0:6505:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788651764.833186:0:6505:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788651764.833266:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147509632:12345-0@lo:256: Request processed in 115us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.833273:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788651764.833332:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147509632:0@lo:256: 10000000:01000000:0.0:1788651764.833377:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788651764.833384:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.833392:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651764.833400:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788651764.833402:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788651764.833405:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788651764.833423:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.833431:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.833461:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651764.833473:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147509760:0@lo:101: 00000100:00100000:0.0:1788651764.833500:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.833522:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc55cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.833534:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147509760 00000100:00100000:0.0:1788651764.833538:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147509760 00000100:00100000:0.0:1788651764.833554:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788651764.833559:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147509760:12345-0@lo:101: 00010000:00010000:0.0:1788651764.833566:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651764.833575:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3ba6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3b9f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.833589:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b9f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.833597:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b9f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.833604:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5200, rc 0) 00000100:00100000:0.0:1788651764.833644:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147509760:12345-0@lo:101: Request processed in 84us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.833650:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788651764.833698:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147509760:0@lo:101: 00010000:00010000:0.0:1788651764.833708:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.833727:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651764.833780:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147509888:0@lo:501: 00000100:00100000:0.0:1788651764.833805:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.833816:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc55cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.833855:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147509888 00000100:00100000:0.0:1788651764.833859:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147509888 00000100:00100000:0.0:1788651764.833875:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788651764.833880:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147509888:12345-0@lo:501: 00000100:00100000:0.0:1788651764.834013:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147509888:12345-0@lo:501: Request processed in 131us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.834020:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 40000000:02000000:0.0:1788651764.834049:0:6516:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788651764.847332:0:6516:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8436:x1875537147509248:12345-0@lo:700: Request processed in 24552us (24636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.847348:0:6516:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788651764.848716:0:8436:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c23af480 x1875537147509248/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788651780 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651764.848733:0:8436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23af480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8436:1875537147509248:0@lo:700: 40000000:02000000:2.0:1788651764.848749:0:8436:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:0.0:1788651764.852330:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147509888:0@lo:501: 00000100:00100000:0.0:1788651764.852414:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147510016:0@lo:503: 00000100:00100000:0.0:1788651764.854106:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.854158:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.854190:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147510016 00000100:00100000:0.0:1788651764.854198:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147510016 00000100:00100000:0.0:1788651764.854257:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788651764.854267:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147510016:12345-0@lo:503: 00000100:00100000:0.0:1788651764.855047:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147510016:12345-0@lo:503: Request processed in 779us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.855057:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788651764.855140:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147510016:0@lo:503: 00000100:00100000:0.0:1788651764.855385:0:9836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9836:1875537147510144:0@lo:502: 00000100:00100000:0.0:1788651764.856167:0:9836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.856245:0:9836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f480 going to sleep for 11 seconds 00000001:00100000:2.0:1788651764.867424:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788651764.867563:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147510144 00000100:00100000:3.0:1788651764.867577:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147510144 00000100:00100000:3.0:1788651764.867658:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788651764.867670:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:9836:x1875537147510144:12345-0@lo:502: 00000100:00100000:3.0:1788651764.867847:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:9836:x1875537147510144:12345-0@lo:502: Request processed in 178us (11680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651764.867860:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788651764.868582:0:9836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9836:1875537147510144:0@lo:502: 00000020:01000000:3.0:1788651764.868637:0:9836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788651764.868645:0:9836:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788651764.868653:0:9836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651764.868656:0:9836:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788651764.868662:0:9836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788651764.868666:0:9836:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:01000000:3.0:1788651764.868690:0:9836:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788651764.868692:0:9836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788651764.868709:0:9836:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f85c2ae19c0) 00000020:00000080:3.0:1788651764.868733:0:9836:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788651764.868739:0:9836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788651764.868828:0:9836:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788651764.868835:0:9836:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788651764.868842:0:9836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c3bb4 00010000:00080000:3.0:1788651764.868872:0:9836:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c32cf000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:3.0:1788651764.871706:0:9836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1788651764.871894:0:9836:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788651764.871929:0:9836:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788651764.873785:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9834:x1875537147508864:12345-0@lo:700: Request processed in 51172us (64237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.873808:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788651764.873892:0:9834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34ad180 x1875537147508864/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788651780 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651764.873926:0:9834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9834:1875537147508864:0@lo:700: 00000040:00080000:3.0:1788651764.875793:0:9836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788651764.877194:0:9836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788651764.877346:0:9836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788651764.877589:0:9836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788651764.881209:0:9837:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651764.881216:0:9837:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1788651764.883537:0:9834:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788651764.883569:0:9834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9834:1875537147510400:0@lo:7: 00000100:00100000:2.0:1788651764.883648:0:9834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.883689:0:9834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651764.883704:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651764.883716:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147510272:0@lo:13: 00000100:00100000:2.0:1788651764.883742:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.884012:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147510400 00000100:00100000:3.0:1788651764.884020:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147510400 00000100:00100000:3.0:1788651764.884068:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788651764.884076:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9834:x1875537147510400:12345-0@lo:7: 00000100:00100000:0.0:1788651764.885074:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147510272 00000100:00100000:0.0:1788651764.885083:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147510272 00000100:00100000:0.0:1788651764.885132:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788651764.886030:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875537147510272:12345-0@lo:13: 00002000:00000024:0.0:1788651764.886071:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923939328 avail 3692417024 00000100:00100000:0.0:1788651764.886159:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3635:x1875537147510272:12345-0@lo:13: Request processed in 1018us (2415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.886167:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1788651764.886232:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34ad180 x1875537147510272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651764.886252:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147510272:0@lo:13: 00000020:00000080:0.0:1788651764.895302:0:9836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788651764.895319:0:9836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788651764.895363:0:9836:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788651764.895389:0:9836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c3bbb 00000100:00080000:0.0:1788651764.895399:0:9836:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788651764.895405:0:9836:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f85c32cf000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788651764.895692:0:9836:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c23ac700 x1875537147510528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788651764.895745:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147510528:0@lo:8: 00000100:00100000:0.0:1788651764.895812:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788651764.895859:0:9836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788651764.895926:0:9836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651764.895930:0:9836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651764.895932:0:9836:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788651764.895935:0:9836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651764.895939:0:9836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651764.895940:0:9836:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788651764.895943:0:9836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788651764.895944:0:9836:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788651764.896038:0:9836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9836:1875537147510656:0@lo:502: 00000100:00100000:0.0:1788651764.896075:0:9836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.896210:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147510656 00000100:00100000:0.0:1788651764.896217:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147510656 00000100:00100000:0.0:1788651764.896279:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788651764.896291:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:9836:x1875537147510656:12345-0@lo:502: 00000100:00100000:0.0:1788651764.896398:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:9836:x1875537147510656:12345-0@lo:502: Request processed in 110us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.896405:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788651764.896559:0:9836:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.896577:0:9836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:9836:1875537147510656:0@lo:502: 00000020:01000000:0.0:1788651764.896694:0:9836:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651764.896699:0:9836:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651764.896701:0:9836:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788651764.896705:0:9836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:0.0:1788651764.896764:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:0.0:1788651764.896784:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788651764.896799:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.896810:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651764.896820:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788651764.896823:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f86da6c3380 from 1 10000000:01000000:0.0:1788651764.896825:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788651764.896850:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.896858:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.896867:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651764.896879:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147510784:0@lo:101: 00000100:00100000:0.0:1788651764.896942:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.897025:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.901298:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147510784 00000100:00100000:0.0:1788651764.901312:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147510784 00000100:00100000:0.0:1788651764.901369:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788651764.901379:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147510784:12345-0@lo:101: 00010000:00010000:0.0:1788651764.901395:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651764.901415:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c3bc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3bc2 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.901443:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c3bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3bc2 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.901464:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c3bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3bc2 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.901475:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5400, rc 0) 00000100:00100000:0.0:1788651764.901554:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147510784:12345-0@lo:101: Request processed in 176us (4611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.901562:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788651764.901647:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147510528 00000100:00100000:2.0:1788651764.901654:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147510528 00000100:00100000:2.0:1788651764.901684:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788651764.901690:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3634:x1875537147510528:12345-0@lo:8: 00010000:00080000:2.0:1788651764.901721:0:8744:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:2.0:1788651764.901748:0:8744:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c3bd0 00002000:00100000:2.0:1788651764.901762:0:8744:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f85c354d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788651764.901767:0:8744:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788651764.901770:0:8744:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788651764.901829:0:8744:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788651764.901855:0:8744:0:(import.c:65:import_set_state_nolock()) ffff8f85c3549000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788651764.901899:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3634:x1875537147510528:12345-0@lo:8: Request processed in 208us (6086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.901927:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788651764.902413:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147510784:0@lo:101: 00010000:00010000:0.0:1788651764.902435:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.902446:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651764.902517:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147510912:0@lo:501: 00000100:00100000:0.0:1788651764.902556:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.902594:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788651764.902615:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147510912 00000100:00100000:2.0:1788651764.902633:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147510912 00010000:00080000:0.0:1788651764.902646:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c23ac700 x1875537147510528/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788651774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651764.902656:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1788651764.902664:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00080000:0.0:1788651764.902664:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:2.0:1788651764.902676:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147510912:12345-0@lo:501: 00000100:00080000:0.0:1788651764.902676:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788651764.902685:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788651764.902689:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c32cf000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788651764.902706:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788651764.902710:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147510528:0@lo:8: 00000100:00100000:2.0:1788651764.902769:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147510912:12345-0@lo:501: Request processed in 95us (211us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788651764.902778:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147510912:0@lo:501: 00000100:00100000:2.0:1788651764.902779:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000004:00080000:2.0:1788651764.902815:0:9837:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 10000000:01000000:0.0:1788651764.902820:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788651764.902827:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651764.902835:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788651764.902865:0:9837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 220837956515ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788651764.902873:0:9837:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:3.0:1788651764.904991:0:8427:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788651764.905005:0:8427:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:3.0:1788651764.905086:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:9834:x1875537147510400:12345-0@lo:7: Request processed in 21009us (21436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651764.905097:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788651764.905653:0:9834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34ac000 x1875537147510400/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788651780 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651764.905670:0:9834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9834:1875537147510400:0@lo:7: 00000004:00080000:2.0:1788651764.905699:0:9834:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788651764.905747:0:9834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9834:1875537147511040:0@lo:5: 00000100:00100000:2.0:1788651764.905792:0:9834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.905823:0:9834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651764.905846:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147511040 00000100:00100000:2.0:1788651764.905853:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147511040 00000100:00100000:2.0:1788651764.905897:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788651764.905921:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9834:x1875537147511040:12345-0@lo:5: 00002000:00080000:2.0:1788651764.905952:0:8429:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1788651764.905985:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9834:x1875537147511040:12345-0@lo:5: Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651764.905992:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788651764.906022:0:9834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34ac000 x1875537147511040/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651780 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651764.906033:0:9834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9834:1875537147511040:0@lo:5: 00000004:00080000:2.0:1788651764.906041:0:9834:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788651764.906064:0:9834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9834:1875537147511168:0@lo:5: 00000100:00100000:2.0:1788651764.906085:0:9834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.906102:0:9834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651764.906659:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147511168 00000100:00100000:0.0:1788651764.906666:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147511168 00000100:00100000:0.0:1788651764.906704:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788651764.906712:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9834:x1875537147511168:12345-0@lo:5: 00002000:00080000:0.0:1788651764.906742:0:8428:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:0.0:1788651764.912725:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9834:x1875537147511168:12345-0@lo:5: Request processed in 6007us (6632us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788651764.912738:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788651764.912786:0:9834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34ac000 x1875537147511168/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651780 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651764.912805:0:9834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34ac000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9834:1875537147511168:0@lo:5: 00000004:00080000:2.0:1788651764.912821:0:9834:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1788651764.912864:0:9834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9834:1875537147511296:0@lo:900: 00000100:00100000:2.0:1788651764.912903:0:9834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651764.912970:0:9834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651764.913044:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147511296 00000100:00100000:3.0:1788651764.913051:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147511296 00000100:00100000:3.0:1788651764.913099:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788651764.913108:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9834:x1875537147511296:12345-0@lo:900: 00000100:00100000:3.0:1788651764.913156:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:9834:x1875537147511296:12345-0@lo:900: Request processed in 49us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651764.913163:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788651764.913299:0:9834:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34aea00 x1875537147511296/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788651780 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651764.913310:0:9834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34aea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9834:1875537147511296:0@lo:900: 00000004:00080000:2.0:1788651764.914696:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788651764.915003:0:9838:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788651764.915028:0:9838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9838:1875537147511552:0@lo:7: 00000100:00100000:0.0:1788651764.915083:0:9838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651764.915084:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651764.915099:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147511424:0@lo:13: 00000100:00100000:0.0:1788651764.915124:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147511552 00000100:00100000:0.0:1788651764.915131:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147511552 00000100:00100000:3.0:1788651764.915143:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.915188:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788651764.915196:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9838:x1875537147511552:12345-0@lo:7: 00000100:00100000:1.0:1788651764.916231:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147511424 00000100:00100000:1.0:1788651764.916239:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147511424 00000100:00100000:1.0:1788651764.916287:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788651764.916297:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875537147511424:12345-0@lo:13: 00002000:00000024:1.0:1788651764.916315:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1788651764.916454:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2833800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3638:x1875537147511424:12345-0@lo:13: Request processed in 159us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651764.916472:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788651764.916580:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c23ad180 x1875537147511424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651780 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651764.916602:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147511424:0@lo:13: 00000100:00080000:2.0:1788651764.917403:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651764.917420:0:9838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f840 going to sleep for 11 seconds 00002000:00080000:0.0:1788651764.925889:0:8429:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1788651764.925897:0:8429:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788651764.927163:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9838:x1875537147511552:12345-0@lo:7: Request processed in 11959us (12072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.927185:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788651764.927416:0:9838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c23ac700 x1875537147511552/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788651780 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651764.927430:0:9838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9838:1875537147511552:0@lo:7: 00000004:00080000:0.0:1788651764.927444:0:9838:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788651764.927485:0:9838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9838:1875537147511680:0@lo:5: 00000100:00100000:0.0:1788651764.927519:0:9838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.927542:0:9838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f840 going to sleep for 11 seconds 00000100:00100000:2.0:1788651764.928609:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147511680 00000100:00100000:2.0:1788651764.928631:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147511680 00000100:00100000:2.0:1788651764.928684:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788651764.928695:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9838:x1875537147511680:12345-0@lo:5: 00002000:00080000:2.0:1788651764.928733:0:8427:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788651764.928736:0:8427:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788651764.933556:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000001:00080000:3.0:1788651764.933578:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1788651764.933586:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788651764.934575:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9838:x1875537147511680:12345-0@lo:5: Request processed in 5874us (7048us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788651764.934589:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788651764.935191:0:9838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c23ac700 x1875537147511680/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651780 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651764.935204:0:9838:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788651764.935210:0:9838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ac700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9838:1875537147511680:0@lo:5: 00000004:00080000:1.0:1788651764.935225:0:9838:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788651764.935322:0:9838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9838:1875537147511808:0@lo:700: 00000100:00100000:0.0:1788651764.935379:0:9838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.935414:0:9838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651764.936866:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147511808 00000100:00100000:1.0:1788651764.936877:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147511808 00000100:00100000:1.0:1788651764.936940:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788651764.936951:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9838:x1875537147511808:12345-0@lo:700: 00000100:00100000:0.0:1788651764.959224:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9838:x1875537147511808:12345-0@lo:700: Request processed in 22266us (23836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651764.959241:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788651764.959381:0:9838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c23ace00 x1875537147511808/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788651780 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651764.959398:0:9838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9838:1875537147511808:0@lo:700: 00000004:02000040:0.0:1788651764.960899:0:9838:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:0.0:1788651764.968550:0:9838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9838:1875537147511936:0@lo:5: 00000100:00100000:0.0:1788651764.969819:0:9838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651764.969876:0:9838:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651764.969952:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147511936 00000100:00100000:2.0:1788651764.969961:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147511936 00000100:00100000:2.0:1788651764.970007:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788651764.970015:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:9838:x1875537147511936:12345-0@lo:5: 00002000:00080000:3.0:1788651764.986193:0:8744:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788651764.986218:0:8744:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:2.0:1788651764.993323:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:9838:x1875537147511936:12345-0@lo:5: Request processed in 23301us (23502us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788651764.993335:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788651764.993760:0:9838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c23ad180 x1875537147511936/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788651780 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651764.993776:0:9838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9838:1875537147511936:0@lo:5: 00000004:00080000:0.0:1788651764.993790:0:9838:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:0.0:1788651765.222680:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788651765.339246:0:9877:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788651766.242728:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147512064:0@lo:13: 00000100:00100000:3.0:1788651766.242800:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651766.242878:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147512064 00000100:00100000:3.0:1788651766.242886:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147512064 00000100:00100000:3.0:1788651766.242954:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788651766.242964:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147512064:12345-0@lo:13: 00002000:00000024:3.0:1788651766.243000:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651766.243059:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147512064:12345-0@lo:13: Request processed in 96us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651766.243066:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788651766.243086:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788651766.243110:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2832d80 x1875537147512064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651766.243127:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147512064:0@lo:13: 00000100:00100000:0.0:1788651766.245821:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651766.245841:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147512192:0@lo:13: 00000100:00100000:0.0:1788651766.245899:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651766.245967:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147512192 00000100:00100000:0.0:1788651766.245974:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147512192 00000100:00100000:0.0:1788651766.246018:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788651766.246025:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147512192:12345-0@lo:13: 00002000:00000024:0.0:1788651766.246145:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651766.246185:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147512192:12345-0@lo:13: Request processed in 160us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651766.246193:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788651766.246212:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788651766.246251:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:0.0:1788651766.246273:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3589880 x1875537147512192/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651766.246290:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147512192:0@lo:13: 00000020:00000004:0.0:1788651766.391256:0:9929:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788651766.391683:0:9929:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788651767.265283:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651767.265406:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651767.265427:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147512320:0@lo:41: 00000100:00100000:2.0:1788651767.265494:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651767.265690:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147512320 00000100:00100000:3.0:1788651767.265710:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147512320 00000100:00100000:3.0:1788651767.265760:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788651767.265770:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147512320:12345-0@lo:41: 00000004:00000024:3.0:1788651767.265803:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651767.265848:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147512320:12345-0@lo:41: Request processed in 79us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651767.265854:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788651767.266010:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147512320:0@lo:41: 00000001:00080000:0.0:1788651767.331484:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1788651768.288096:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651768.801058:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651768.801084:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147512448:0@lo:41: 00000100:00100000:0.0:1788651768.801164:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651768.801236:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147512448 00000100:00100000:0.0:1788651768.801246:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147512448 00000100:00100000:0.0:1788651768.801297:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788651768.801307:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147512448:12345-0@lo:41: 00000004:00000024:0.0:1788651768.801345:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788651768.801411:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147512448:12345-0@lo:41: Request processed in 104us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651768.801418:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788651768.801472:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3589880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147512448:0@lo:41: 00010000:00010000:0.0:1788651769.313394:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788651769.315829:0:10030:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788651769.317823:0:10030:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000020:00000004:1.0:1788651770.137720:0:10079:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788651770.137730:0:10079:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:3.0:1788651770.336874:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651770.336899:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147512576:0@lo:13: 00000100:00100000:3.0:1788651770.336981:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.337851:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147512576 00000100:00100000:0.0:1788651770.337862:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147512576 00000100:00100000:0.0:1788651770.337945:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788651770.337957:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147512576:12345-0@lo:13: 00002000:00000024:0.0:1788651770.337988:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651770.338051:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147512576:12345-0@lo:13: Request processed in 97us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.338059:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788651770.338082:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788651770.338115:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2831500 x1875537147512576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651770.338127:0:3637:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:0.0:1788651770.338153:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2831500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147512576:0@lo:13: 00010000:00010000:0.0:1788651770.338225:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651770.338483:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147512704:0@lo:13: 00000100:00100000:0.0:1788651770.338530:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.339597:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147512832:0@lo:400: 00000100:00100000:0.0:1788651770.339646:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.339680:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147513344:0@lo:400: 00000100:00100000:0.0:1788651770.339706:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.339725:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147513856:0@lo:400: 00000100:00100000:0.0:1788651770.339759:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.339779:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788651770.339785:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147513216:0@lo:400: 00000100:00100000:0.0:1788651770.339809:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.339827:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147513728:0@lo:400: 00000100:00100000:0.0:1788651770.339847:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.339876:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147512832 00000100:00100000:0.0:1788651770.339884:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147512832 00000100:00100000:0.0:1788651770.339949:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788651770.339958:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147512832:12345-0@lo:400: 00000100:00100000:0.0:1788651770.340007:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147512832:12345-0@lo:400: Request processed in 51us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.340014:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788651770.340045:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147513344 00000100:00100000:0.0:1788651770.340049:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147513344 00000100:00100000:0.0:1788651770.340074:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788651770.340080:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147513344:12345-0@lo:400: 00000100:00100000:0.0:1788651770.340113:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147513344:12345-0@lo:400: Request processed in 34us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.340120:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788651770.340137:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147513856 00000100:00100000:0.0:1788651770.340141:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147513856 00000100:00100000:0.0:1788651770.340169:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147513728 00000100:00100000:0.0:1788651770.340171:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147513728 00000100:00100000:0.0:1788651770.340191:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788651770.340197:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147513856:12345-0@lo:400: 00000100:00100000:0.0:1788651770.340226:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147513856:12345-0@lo:400: Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.340238:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788651770.340250:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788651770.340256:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147513728:12345-0@lo:400: 00000100:00100000:0.0:1788651770.340283:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147513728:12345-0@lo:400: Request processed in 28us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.340288:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788651770.340305:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147513216 00000100:00100000:0.0:1788651770.340308:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147513216 00000100:00100000:0.0:1788651770.340334:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788651770.340341:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147513216:12345-0@lo:400: 00000100:00100000:0.0:1788651770.340370:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147513216:12345-0@lo:400: Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.340377:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788651770.340413:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a51500 x1875537147513216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651770.340426:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147513216:0@lo:400: 00010000:00080000:0.0:1788651770.340437:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a51c00 x1875537147513728/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651770.340445:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147513728:0@lo:400: 00000100:00100000:0.0:1788651770.340454:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147512832:0@lo:400: 00000100:00100000:0.0:1788651770.340463:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147513344:0@lo:400: 00010000:00080000:0.0:1788651770.340471:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a50700 x1875537147513856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651770.340479:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147513856:0@lo:400: 00000100:00080000:0.0:1788651770.340526:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651770.340547:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147512960:0@lo:400: 00000100:00100000:0.0:1788651770.340576:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.340593:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147513472:0@lo:400: 00000100:00100000:0.0:1788651770.340612:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.340627:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147513984:0@lo:400: 00000100:00100000:0.0:1788651770.340646:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.340661:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788651770.340667:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147513088:0@lo:400: 00000100:00100000:0.0:1788651770.340687:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.340703:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147513600:0@lo:400: 00000100:00100000:0.0:1788651770.340724:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.340733:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147514112:0@lo:400: 00000100:00100000:0.0:1788651770.340750:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651770.340768:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147512960 00000100:00100000:0.0:1788651770.340772:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147512960 00000100:00100000:0.0:1788651770.340788:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147513472 00000100:00100000:0.0:1788651770.340791:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147513472 00000100:00100000:0.0:1788651770.340807:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147513984 00000100:00100000:0.0:1788651770.340809:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147513984 00000100:00100000:0.0:1788651770.340819:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147513600 00000100:00100000:0.0:1788651770.340822:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147513600 00000100:00100000:0.0:1788651770.340831:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147514112 00000100:00100000:0.0:1788651770.340833:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147514112 00000100:00100000:0.0:1788651770.340846:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788651770.340852:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147512960:12345-0@lo:400: 00000100:00100000:0.0:1788651770.340885:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147512960:12345-0@lo:400: Request processed in 33us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.340897:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788651770.340932:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788651770.340939:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147513472:12345-0@lo:400: 00000100:00100000:0.0:1788651770.340967:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147513472:12345-0@lo:400: Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.340973:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788651770.340985:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788651770.340990:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147513984:12345-0@lo:400: 00000100:00100000:0.0:1788651770.341014:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147513984:12345-0@lo:400: Request processed in 24us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.341020:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788651770.341030:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788651770.341036:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147513600:12345-0@lo:400: 00000100:00100000:0.0:1788651770.341062:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3589180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147513600:12345-0@lo:400: Request processed in 26us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.341068:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788651770.341080:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788651770.341085:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147514112:12345-0@lo:400: 00000100:00100000:0.0:1788651770.341112:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147514112:12345-0@lo:400: Request processed in 26us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.341117:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788651770.341139:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147513088 00000100:00100000:0.0:1788651770.341142:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147513088 00000100:00100000:0.0:1788651770.341163:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788651770.341169:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147513088:12345-0@lo:400: 00000100:00100000:0.0:1788651770.341210:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147513088:12345-0@lo:400: Request processed in 41us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.341216:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788651770.341231:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651770.341234:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651770.341253:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147513088:0@lo:400: 00010000:00080000:0.0:1788651770.341262:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a52680 x1875537147513600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651770.341270:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147513600:0@lo:400: 00010000:00080000:0.0:1788651770.341278:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a51180 x1875537147514112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651770.341285:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147514112:0@lo:400: 00010000:00080000:0.0:1788651770.341292:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a50e00 x1875537147512960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651770.341298:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147512960:0@lo:400: 00010000:00080000:0.0:1788651770.341305:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a53100 x1875537147513472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651770.341312:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147513472:0@lo:400: 00010000:00080000:0.0:1788651770.341319:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a50a80 x1875537147513984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651770.341326:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147513984:0@lo:400: 00000100:00100000:3.0:1788651770.344727:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147512704 00000100:00100000:3.0:1788651770.344743:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147512704 00000100:00100000:3.0:1788651770.344808:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788651770.344818:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147512704:12345-0@lo:13: 00002000:00000024:3.0:1788651770.344842:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651770.344934:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147512704:12345-0@lo:13: Request processed in 118us (6404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651770.344942:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788651770.345055:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788651770.348627:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2831f80 x1875537147512704/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651786 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651770.348659:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788651770.348694:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147512704:0@lo:13: 00000100:00100000:2.0:1788651770.684192:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651770.684825:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125441664 00000100:00100000:3.0:1788651770.684837:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125441664 00000100:00100000:3.0:1788651770.684893:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 183 00000100:00100000:3.0:1788651770.684903:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2387:x1875537125441664:12345-192.168.204.45@tcp:250: 00010000:00080000:3.0:1788651770.684953:0:6502:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f5181ca9-d102-4cac-a75c-a4c1a36c2137@192.168.204.45@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1788651770.684994:0:6502:0:(genops.c:1385:class_connect()) connect: client f5181ca9-d102-4cac-a75c-a4c1a36c2137, cookie 0xcd2f56ea038c3bd7 00000100:00080000:3.0:1788651770.685155:0:6502:0:(import.c:65:import_set_state_nolock()) ffff8f85c32c9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788651770.685440:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+5:2387:x1875537125441664:12345-192.168.204.45@tcp:250: Request processed in 336us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651770.685449:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 183 00000100:00100000:2.0:1788651770.689479:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651770.689553:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125441792 00000100:00100000:0.0:1788651770.689563:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125441792 00000100:00100000:0.0:1788651770.689632:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 184 00000100:00100000:0.0:1788651770.689642:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+5:6152:x1875537125441792:12345-192.168.204.45@tcp:101: 00010000:00010000:0.0:1788651770.689658:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651770.689676:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3bde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ab3 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651770.689705:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ab3 expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651770.689716:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ab3 expref: 6 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651770.689725:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5600, rc 0) 00000100:00100000:0.0:1788651770.689787:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+6:6152:x1875537125441792:12345-192.168.204.45@tcp:101: Request processed in 147us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.689795:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 184 00000100:00100000:2.0:1788651770.702442:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651770.702494:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125441920 00000100:00100000:3.0:1788651770.702504:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125441920 00000100:00100000:3.0:1788651770.702570:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 185 00000100:00100000:3.0:1788651770.702580:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+6:6152:x1875537125441920:12345-192.168.204.45@tcp:501: 00000100:00100000:3.0:1788651770.702704:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+6:6152:x1875537125441920:12345-192.168.204.45@tcp:501: Request processed in 125us (271us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788651770.702713:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 185 00000100:00100000:1.0:1788651770.715562:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651770.715664:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125442048 00000100:00100000:2.0:1788651770.715675:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125442048 00000100:00100000:2.0:1788651770.715732:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 186 00000100:00100000:2.0:1788651770.715742:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+6:6152:x1875537125442048:12345-192.168.204.45@tcp:101: 00010000:00010000:2.0:1788651770.715757:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651770.715774:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c3be5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33aba expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651770.715801:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c3be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aba expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651770.715812:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c3be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aba expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651770.715821:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc800, rc 0) 00000100:00100000:2.0:1788651770.715885:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+7:6152:x1875537125442048:12345-192.168.204.45@tcp:101: Request processed in 144us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651770.715892:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 186 00000100:00100000:2.0:1788651770.725038:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651770.729256:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125442176 00000100:00100000:3.0:1788651770.729273:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125442176 00000100:00100000:2.0:1788651770.735793:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 187 00000100:00100000:2.0:1788651770.735810:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+7:6152:x1875537125442176:12345-192.168.204.45@tcp:501: 00000100:00100000:2.0:1788651770.736281:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:6152:x1875537125442176:12345-192.168.204.45@tcp:501: Request processed in 473us (11251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651770.736304:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 187 00000100:00100000:1.0:1788651770.739047:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651770.739265:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125442304 00000100:00100000:2.0:1788651770.739274:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125442304 00000100:00100000:2.0:1788651770.739339:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 188 00000100:00100000:2.0:1788651770.739348:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:6152:x1875537125442304:12345-192.168.204.45@tcp:503: 00000100:00100000:2.0:1788651770.739685:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:6152:x1875537125442304:12345-192.168.204.45@tcp:503: Request processed in 337us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651770.739694:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 188 00000100:00100000:1.0:1788651770.746448:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651770.746559:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125442432 00000100:00100000:2.0:1788651770.746568:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125442432 00000100:00100000:2.0:1788651770.746665:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 189 00000100:00100000:2.0:1788651770.746676:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:6170:x1875537125442432:12345-192.168.204.45@tcp:502: 00000100:00100000:2.0:1788651770.746822:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:6170:x1875537125442432:12345-192.168.204.45@tcp:502: Request processed in 147us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651770.746840:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 189 00000100:00100000:1.0:1788651770.785897:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651770.786112:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125442560 00000100:00100000:0.0:1788651770.786123:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125442560 00000100:00100000:0.0:1788651770.786181:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 190 00000100:00100000:0.0:1788651770.786191:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:6170:x1875537125442560:12345-192.168.204.45@tcp:502: 00000100:00100000:0.0:1788651770.786369:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:6170:x1875537125442560:12345-192.168.204.45@tcp:502: Request processed in 179us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.786387:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 190 00000100:00100000:1.0:1788651770.794543:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651770.794649:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125442688 00000100:00100000:2.0:1788651770.794660:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125442688 00000100:00100000:2.0:1788651770.794725:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 191 00000100:00100000:2.0:1788651770.794734:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:6152:x1875537125442688:12345-192.168.204.45@tcp:101: 00010000:00010000:2.0:1788651770.794751:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651770.794769:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dc200/0xcd2f56ea038c3bec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33aeb expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651770.794800:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dc200/0xcd2f56ea038c3bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aeb expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651770.794837:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dc200/0xcd2f56ea038c3bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aeb expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651770.794847:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc200, rc 0) 00000100:00100000:2.0:1788651770.794957:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6152:x1875537125442688:12345-192.168.204.45@tcp:101: Request processed in 223us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651770.794965:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 191 00000100:00100000:1.0:1788651770.815278:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651770.815370:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125442816 00000100:00100000:3.0:1788651770.815381:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125442816 00000100:00100000:3.0:1788651770.815439:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 192 00000100:00100000:3.0:1788651770.815462:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6152:x1875537125442816:12345-192.168.204.45@tcp:256: 20000000:01000000:3.0:1788651770.815487:0:6502:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788651770.815522:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788651770.815527:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788651770.815530:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788651770.815538:0:6502:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788651770.815541:0:6502:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788651770.818024:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6152:x1875537125442816:12345-192.168.204.45@tcp:256: Request processed in 2555us (2736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651770.818037:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 192 00000100:00100000:1.0:1788651770.821009:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651770.821117:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125442944 00000100:00100000:0.0:1788651770.821131:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125442944 00000100:00100000:0.0:1788651770.821199:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 193 00000100:00100000:0.0:1788651770.821207:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6152:x1875537125442944:12345-192.168.204.45@tcp:101: 00010000:00010000:0.0:1788651770.821226:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651770.821242:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3bf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33af2 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651770.821269:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33af2 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651770.821279:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33af2 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651770.821287:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4200, rc 0) 00000100:00100000:0.0:1788651770.821347:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6152:x1875537125442944:12345-192.168.204.45@tcp:101: Request processed in 140us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651770.821353:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 193 00000100:00100000:1.0:1788651770.823744:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651770.823825:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125443072 00000100:00100000:3.0:1788651770.823834:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125443072 00000100:00100000:3.0:1788651770.823888:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 194 00000100:00100000:3.0:1788651770.823897:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6152:x1875537125443072:12345-192.168.204.45@tcp:501: 00000100:00100000:2.0:1788651770.824809:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6152:x1875537125443072:12345-192.168.204.45@tcp:501: Request processed in 908us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651770.824819:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 194 00000100:00100000:1.0:1788651770.828990:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651770.829242:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125443200 00000100:00100000:2.0:1788651770.829253:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125443200 00000100:00100000:2.0:1788651770.829369:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 195 00000100:00100000:2.0:1788651770.829379:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6152:x1875537125443200:12345-192.168.204.45@tcp:503: 00000100:00100000:2.0:1788651770.829638:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6152:x1875537125443200:12345-192.168.204.45@tcp:503: Request processed in 260us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651770.829646:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 195 00000100:00100000:1.0:1788651770.833961:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651770.834122:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125443328 00000100:00100000:2.0:1788651770.834133:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125443328 00000100:00100000:2.0:1788651770.834186:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 196 00000100:00100000:2.0:1788651770.834195:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6176:x1875537125443328:12345-192.168.204.45@tcp:502: 00000100:00100000:2.0:1788651770.834586:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6176:x1875537125443328:12345-192.168.204.45@tcp:502: Request processed in 391us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651770.834595:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 196 00000100:00100000:1.0:1788651770.837581:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651770.837686:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125443456 00000100:00100000:2.0:1788651770.837707:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125443456 00000100:00100000:2.0:1788651770.837805:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 197 00000100:00100000:2.0:1788651770.837817:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6176:x1875537125443456:12345-192.168.204.45@tcp:502: 00000100:00100000:2.0:1788651770.837985:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6176:x1875537125443456:12345-192.168.204.45@tcp:502: Request processed in 170us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651770.837994:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 197 00000100:00100000:2.0:1788651770.841562:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651770.841608:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651770.842003:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125443584 00000100:00100000:3.0:1788651770.842061:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125443584 00000100:00100000:3.0:1788651770.842143:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125443840 00000100:00100000:3.0:1788651770.842147:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125443840 00000100:00100000:3.0:1788651770.842164:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:3.0:1788651770.842171:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2387:x1875537125443584:12345-192.168.204.45@tcp:38: 00010000:00080000:3.0:1788651770.842206:0:6510:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1788651770.842261:0:6510:0:(genops.c:1385:class_connect()) connect: client 72121fb7-fb91-4477-92d5-4e7fe3e6b65d, cookie 0xcd2f56ea038c3bfa 00000004:00100000:3.0:1788651770.842293:0:6510:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788651770.842525:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8f85c32cf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788651770.842594:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2387:x1875537125443584:12345-192.168.204.45@tcp:38: Request processed in 421us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651770.842602:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:3.0:1788651770.842620:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:3.0:1788651770.842625:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2387:x1875537125443840:12345-192.168.204.45@tcp:38: 00010000:00080000:3.0:1788651770.842639:0:6510:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp t0 exp 0000000000000000 cur 226 last 0 00000020:00000080:3.0:1788651770.842695:0:6510:0:(genops.c:1385:class_connect()) connect: client 72121fb7-fb91-4477-92d5-4e7fe3e6b65d, cookie 0xcd2f56ea038c3c01 00000004:00100000:3.0:1788651770.842713:0:6510:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788651770.842999:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8f86eeabf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788651770.843095:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2387:x1875537125443840:12345-192.168.204.45@tcp:38: Request processed in 467us (1485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651770.843102:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 8 00010000:00010000:0.0:1788651771.360235:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651771.360439:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651771.362761:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147514368:0@lo:13: 00000100:00100000:1.0:1788651771.362837:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651771.362941:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147514240:0@lo:13: 00000100:00100000:1.0:1788651771.362964:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651771.363079:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147514368 00000100:00100000:2.0:1788651771.363088:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147514368 00000100:00100000:2.0:1788651771.363139:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147514240 00000100:00100000:2.0:1788651771.363143:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147514240 00000100:00100000:2.0:1788651771.363159:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788651771.363168:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147514368:12345-0@lo:13: 00002000:00000024:2.0:1788651771.363201:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651771.363259:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147514368:12345-0@lo:13: Request processed in 92us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651771.363266:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788651771.363284:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788651771.363290:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147514240:12345-0@lo:13: 00002000:00000024:2.0:1788651771.363300:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651771.363332:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147514240:12345-0@lo:13: Request processed in 42us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651771.363338:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788651771.363655:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2831880 x1875537147514368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651771.363677:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147514368:0@lo:13: 00010000:00080000:1.0:1788651771.363688:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34af800 x1875537147514240/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651771.363711:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147514240:0@lo:13: 00000100:00100000:2.0:1788651771.850400:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651771.850445:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651771.850481:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651771.850599:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125444096 00000100:00100000:0.0:1788651771.850610:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125444096 00000100:00100000:0.0:1788651771.850672:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125443712 00000100:00100000:0.0:1788651771.850675:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125443712 00000100:00100000:0.0:1788651771.850687:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125443968 00000100:00100000:0.0:1788651771.850689:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125443968 00000100:00100000:0.0:1788651771.850710:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:0.0:1788651771.850719:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:6152:x1875537125444096:12345-192.168.204.45@tcp:41: 00000004:00000024:0.0:1788651771.850896:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788651771.851027:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:6152:x1875537125444096:12345-192.168.204.45@tcp:41: Request processed in 295us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651771.851035:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:0.0:1788651771.851055:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:0.0:1788651771.851062:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:0:x1875537125443712:12345-192.168.204.45@tcp:41: 00000004:00000024:0.0:1788651771.851074:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788651771.851096:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:0:x1875537125443712:12345-192.168.204.45@tcp:41: Request processed in 35us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651771.851103:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:0.0:1788651771.851115:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:0.0:1788651771.851122:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:0:x1875537125443968:12345-192.168.204.45@tcp:41: 00000100:00080000:2.0:1788651771.851397:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788651771.851402:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788651771.851720:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788651771.851766:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:0:x1875537125443968:12345-192.168.204.45@tcp:41: Request processed in 644us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651771.851774:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:2.0:1788651771.856569:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651771.856665:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125444224 00000100:00100000:3.0:1788651771.856676:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125444224 00000100:00100000:3.0:1788651771.856874:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 12 00000100:00100000:3.0:1788651771.856887:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6152:x1875537125444224:12345-192.168.204.45@tcp:40: 00000100:00100000:3.0:1788651771.857184:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6152:x1875537125444224:12345-192.168.204.45@tcp:40: Request processed in 299us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651771.857192:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 12 00000100:00100000:2.0:1788651771.861144:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651771.861518:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125444352 00000100:00100000:0.0:1788651771.861529:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125444352 00000100:00100000:0.0:1788651771.861577:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:0.0:1788651771.861588:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1875537125444352:12345-192.168.204.45@tcp:8: 00010000:00080000:0.0:1788651771.861627:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:0.0:1788651771.861660:0:8428:0:(genops.c:1385:class_connect()) connect: client 72121fb7-fb91-4477-92d5-4e7fe3e6b65d, cookie 0xcd2f56ea038c3c08 00002000:00100000:0.0:1788651771.861673:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 72121fb7-fb91-4477-92d5-4e7fe3e6b65d/ffff8f86eeb00000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788651771.861683:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788651771.861951:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788651771.861983:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8f86eeb00800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651771.862066:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2387:x1875537125444352:12345-192.168.204.45@tcp:8: Request processed in 478us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651771.862074:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:2.0:1788651771.867013:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651771.867058:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651771.867115:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651771.867218:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125444736 00000100:00100000:3.0:1788651771.867230:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125444736 00000100:00100000:3.0:1788651771.867287:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:3.0:1788651771.867311:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6152:x1875537125444736:12345-192.168.204.45@tcp:900: 00000100:00100000:3.0:1788651771.867385:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6152:x1875537125444736:12345-192.168.204.45@tcp:900: Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651771.867393:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:1.0:1788651771.868440:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125444480 00000100:00100000:1.0:1788651771.868449:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125444480 00000100:00100000:1.0:1788651771.868503:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:1.0:1788651771.868509:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2387:x1875537125444480:12345-192.168.204.45@tcp:8: 00010000:00080000:1.0:1788651771.868541:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp t0 exp 0000000000000000 cur 227 last 0 00000020:00000080:1.0:1788651771.868570:0:8429:0:(genops.c:1385:class_connect()) connect: client 72121fb7-fb91-4477-92d5-4e7fe3e6b65d, cookie 0xcd2f56ea038c3c0f 00002000:00100000:1.0:1788651771.868582:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 72121fb7-fb91-4477-92d5-4e7fe3e6b65d/ffff8f85c3181000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788651771.868592:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788651771.868899:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788651771.868974:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f85c3184000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788651771.869043:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2387:x1875537125444480:12345-192.168.204.45@tcp:8: Request processed in 532us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651771.869050:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:0.0:1788651771.870148:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125444608 00000100:00100000:0.0:1788651771.870160:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125444608 00000100:00100000:0.0:1788651771.870222:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 198 00000100:00100000:0.0:1788651771.870231:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2389:x1875537125444608:12345-192.168.204.45@tcp:400: 00000100:00100000:0.0:1788651771.870279:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2389:x1875537125444608:12345-192.168.204.45@tcp:400: Request processed in 50us (3279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651771.870287:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 198 00000100:00100000:2.0:1788651771.873448:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651771.873544:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125444864 00000100:00100000:3.0:1788651771.873553:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125444864 00000100:00100000:3.0:1788651771.873609:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:3.0:1788651771.873618:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6152:x1875537125444864:12345-192.168.204.45@tcp:33: 00000004:00080000:3.0:1788651771.901148:0:6512:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 27426us 00000004:00200000:3.0:1788651771.918240:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788651771.918376:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6152:x1875537125444864:12345-192.168.204.45@tcp:33: Request processed in 44743us (44923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651771.918396:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:1.0:1788651772.184104:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651772.184262:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125444992 00000100:00100000:2.0:1788651772.184274:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125444992 00000100:00100000:2.0:1788651772.184339:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:2.0:1788651772.184350:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6194:x1875537125444992:12345-192.168.204.45@tcp:101: 00010000:00010000:2.0:1788651772.184369:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651772.184396:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3c16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33b23 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651772.184490:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3c1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651772.184506:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3c1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651772.184522:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3c1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651772.184736:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788651772.184740:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651772.184758:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3c1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651772.184784:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3c16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b23 expref: 8 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651772.184819:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3c1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b23 expref: 7 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651772.184828:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651772.184831:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651772.184834:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc000, rc 0) 00000100:00100000:2.0:1788651772.184900:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:6194:x1875537125444992:12345-192.168.204.45@tcp:101: Request processed in 553us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651772.184952:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 13 00010000:00010000:0.0:1788651772.384250:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651772.385075:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651772.385100:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147514496:0@lo:41: 00000100:00100000:1.0:1788651772.385174:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651772.385302:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147514496 00000100:00100000:2.0:1788651772.385312:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147514496 00000100:00100000:2.0:1788651772.385368:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788651772.385377:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147514496:12345-0@lo:41: 00000004:00000024:2.0:1788651772.385410:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788651772.385472:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147514496:12345-0@lo:41: Request processed in 95us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651772.385491:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788651772.385978:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2832a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147514496:0@lo:41: 00010000:00010000:0.0:1788651773.408070:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651773.920256:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c358b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147514624:0@lo:41: 00000100:00100000:3.0:1788651773.920344:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651773.920492:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147514624 00000100:00100000:0.0:1788651773.920500:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147514624 00000100:00100000:0.0:1788651773.920558:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788651773.920568:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147514624:12345-0@lo:41: 00000004:00000024:0.0:1788651773.920603:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788651773.920661:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147514624:12345-0@lo:41: Request processed in 94us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651773.920668:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788651773.920955:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c358b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147514624:0@lo:41: 00010000:00010000:0.0:1788651774.432100:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651774.549462:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651774.549745:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125445120 00000100:00100000:0.0:1788651774.549756:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125445120 00000100:00100000:0.0:1788651774.549835:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00080000:2.0:1788651774.549942:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651774.550045:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:6246:x1875537125445120:12345-192.168.204.45@tcp:41: 00000004:00000024:0.0:1788651774.550084:0:6511:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788651774.550174:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:6246:x1875537125445120:12345-192.168.204.45@tcp:41: Request processed in 132us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651774.552178:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:1.0:1788651774.558234:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651774.558330:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125445248 00000100:00100000:2.0:1788651774.558340:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125445248 00000100:00100000:2.0:1788651774.558415:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:2.0:1788651774.558425:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6246:x1875537125445248:12345-192.168.204.45@tcp:41: 00000004:00000024:2.0:1788651774.558474:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788651774.558543:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6246:x1875537125445248:12345-192.168.204.45@tcp:41: Request processed in 119us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651774.558565:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00080000:0.0:1788651774.559466:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651774.563600:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651774.564063:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125445376 00000100:00100000:2.0:1788651774.564073:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125445376 00000100:00100000:2.0:1788651774.564142:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:2.0:1788651774.564151:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6246:x1875537125445376:12345-192.168.204.45@tcp:13: 00002000:00000024:2.0:1788651774.564180:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651774.564241:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6246:x1875537125445376:12345-192.168.204.45@tcp:13: Request processed in 91us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651774.564248:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00080000:0.0:1788651774.564653:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651774.566296:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651774.566389:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125445504 00000100:00100000:2.0:1788651774.566398:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125445504 00000100:00100000:2.0:1788651774.566517:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:2.0:1788651774.566527:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6246:x1875537125445504:12345-192.168.204.45@tcp:13: 00002000:00000024:2.0:1788651774.566558:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651774.566616:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:6246:x1875537125445504:12345-192.168.204.45@tcp:13: Request processed in 90us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651774.566624:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00080000:0.0:1788651774.570094:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788651775.456373:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651775.456500:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651775.456523:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147514752:0@lo:13: 00000100:00100000:3.0:1788651775.456613:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651775.456681:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147514752 00000100:00100000:3.0:1788651775.456690:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147514752 00000100:00100000:3.0:1788651775.456756:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788651775.456766:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147514752:12345-0@lo:13: 00002000:00000024:3.0:1788651775.456787:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651775.456834:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147514752:12345-0@lo:13: Request processed in 69us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651775.456841:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788651775.456861:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788651775.456890:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2830e00 x1875537147514752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651775.456934:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147514752:0@lo:13: 00000100:00100000:0.0:1788651775.457625:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147514880:0@lo:13: 00000100:00100000:0.0:1788651775.457664:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651775.457839:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147514880 00000100:00100000:3.0:1788651775.457845:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147514880 00000100:00100000:3.0:1788651775.457901:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788651775.457932:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147514880:12345-0@lo:13: 00002000:00000024:3.0:1788651775.457948:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651775.458008:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147514880:12345-0@lo:13: Request processed in 100us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651775.458015:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788651775.458064:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147515008:0@lo:400: 00000100:00100000:3.0:1788651775.458093:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651775.458148:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147515136:0@lo:400: 00000100:00100000:3.0:1788651775.458175:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651775.458206:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147515136 00000100:00100000:3.0:1788651775.458211:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147515136 00000100:00100000:3.0:1788651775.458236:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788651775.458242:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147515136:12345-0@lo:400: 00000100:00100000:3.0:1788651775.458277:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147515136:12345-0@lo:400: Request processed in 35us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651775.458284:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788651775.458319:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147515136:0@lo:400: 00000100:00100000:3.0:1788651775.458352:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147515264:0@lo:400: 00000100:00100000:3.0:1788651775.458378:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651775.458562:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147515008 00000100:00100000:2.0:1788651775.458566:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147515008 00000100:00100000:2.0:1788651775.458601:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788651775.458609:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147515008:12345-0@lo:400: 00000100:00100000:2.0:1788651775.458647:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147515008:12345-0@lo:400: Request processed in 40us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651775.458654:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788651775.458711:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147515264 00000100:00100000:3.0:1788651775.458715:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147515264 00000100:00100000:3.0:1788651775.458752:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788651775.458759:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147515264:12345-0@lo:400: 00000100:00100000:3.0:1788651775.458795:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147515264:12345-0@lo:400: Request processed in 37us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651775.458803:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1788651775.459229:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788651775.460135:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d6680 x1875537147514880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651791 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651775.460155:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147514880:0@lo:13: 00000100:00100000:2.0:1788651775.466076:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147515008:0@lo:400: 00000100:00100000:0.0:1788651775.466571:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147515392:0@lo:400: 00000100:00100000:0.0:1788651775.466640:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651775.467380:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147515904:0@lo:400: 00000100:00100000:0.0:1788651775.467436:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651775.467464:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788651775.467471:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147515776:0@lo:400: 00000100:00100000:0.0:1788651775.467496:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651775.467577:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147515264:0@lo:400: 00000100:00100000:3.0:1788651775.467606:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147515648:0@lo:400: 00000100:00100000:1.0:1788651775.467786:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147515520:0@lo:400: 00000100:00100000:1.0:1788651775.467818:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651775.467837:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147516032:0@lo:400: 00000100:00100000:1.0:1788651775.467856:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651775.467892:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147515904 00000100:00100000:1.0:1788651775.467899:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147515904 00000100:00100000:1.0:1788651775.467964:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147516032 00000100:00100000:1.0:1788651775.467968:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147516032 00000100:00100000:1.0:1788651775.467990:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788651775.467999:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147515904:12345-0@lo:400: 00000100:00100000:1.0:1788651775.468044:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147515904:12345-0@lo:400: Request processed in 46us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651775.468050:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788651775.468068:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788651775.468075:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147516032:12345-0@lo:400: 00000100:00100000:1.0:1788651775.468113:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147516032:12345-0@lo:400: Request processed in 38us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651775.468119:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788651775.468137:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788651775.468158:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5a680 x1875537147516032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651775.468176:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147516032:0@lo:400: 00000100:00100000:3.0:1788651775.468367:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147515520 00000100:00100000:3.0:1788651775.468372:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147515520 00000100:00100000:3.0:1788651775.468425:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788651775.468433:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147515520:12345-0@lo:400: 00000100:00100000:3.0:1788651775.468475:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147515520:12345-0@lo:400: Request processed in 43us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651775.468482:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788651775.468512:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147515520:0@lo:400: 00000100:00100000:0.0:1788651775.468921:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147516288:0@lo:400: 00000100:00100000:0.0:1788651775.468951:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651775.469071:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147515392 00000100:00100000:2.0:1788651775.469076:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147515392 00000100:00100000:2.0:1788651775.469113:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147515776 00000100:00100000:2.0:1788651775.469117:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147515776 00000100:00100000:2.0:1788651775.469138:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788651775.469145:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147515392:12345-0@lo:400: 00000100:00100000:2.0:1788651775.469183:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147515392:12345-0@lo:400: Request processed in 39us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651775.469190:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788651775.469203:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788651775.469210:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147515776:12345-0@lo:400: 00000100:00100000:2.0:1788651775.469238:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147515776:12345-0@lo:400: Request processed in 29us (1741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651775.469244:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1788651775.469300:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788651775.469395:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147516288 00000100:00100000:2.0:1788651775.469411:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147516288 00000100:00100000:2.0:1788651775.469455:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788651775.469461:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147516288:12345-0@lo:400: 00000100:00100000:1.0:1788651775.470084:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651775.470112:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147516160:0@lo:400: 00000100:00100000:1.0:1788651775.470143:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651775.470181:0:6509:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788651775.470189:0:6509:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:1.0:1788651775.470199:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651775.470322:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788651775.470329:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147515648 00000100:00100000:3.0:1788651775.470334:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147515648 00000100:00100000:3.0:1788651775.470360:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788651775.470364:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147516160 00000100:00100000:3.0:1788651775.470367:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147516160 00000100:00100000:3.0:1788651775.470378:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788651775.470384:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788651775.470390:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147515648:12345-0@lo:400: 00000100:00100000:3.0:1788651775.470452:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147515648:12345-0@lo:400: Request processed in 62us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651775.470459:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788651775.470470:0:6511:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788651775.470476:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788651775.470481:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147516160:12345-0@lo:400: 00000100:00100000:3.0:1788651775.470528:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147516160:12345-0@lo:400: Request processed in 46us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651775.470534:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788651775.470563:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651775.470588:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147515648:0@lo:400: 00000100:00100000:3.0:1788651775.470608:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147516160:0@lo:400: 00000100:00100000:0.0:1788651775.471160:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147515392:0@lo:400: 00010000:00080000:0.0:1788651775.471175:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5b100 x1875537147515904/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651775.471185:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147515904:0@lo:400: 00010000:00080000:0.0:1788651775.471219:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5b800 x1875537147515776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651775.471227:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147515776:0@lo:400: 00000100:00100000:2.0:1788651775.471388:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147516288:12345-0@lo:400: Request processed in 1926us (2434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651775.471406:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1788651775.471518:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a58700 x1875537147516288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651775.471528:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147516288:0@lo:400: 00000001:00100000:0.0:1788651775.978548:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00010000:00010000:0.0:1788651776.480413:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651776.482235:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147516416:0@lo:13: 00000100:00100000:0.0:1788651776.482309:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651776.482417:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147516416 00000100:00100000:3.0:1788651776.482426:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147516416 00000100:00100000:3.0:1788651776.482479:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788651776.482489:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147516416:12345-0@lo:13: 00002000:00000024:3.0:1788651776.482516:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651776.482567:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147516416:12345-0@lo:13: Request processed in 80us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651776.482574:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788651776.482613:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2831f80 x1875537147516416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651776.482631:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147516416:0@lo:13: 00000100:00100000:2.0:1788651776.482750:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651776.482760:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147516544:0@lo:13: 00000100:00100000:2.0:1788651776.482821:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651776.482858:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147516544 00000100:00100000:2.0:1788651776.482862:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147516544 00000100:00100000:2.0:1788651776.482883:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788651776.482889:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147516544:12345-0@lo:13: 00002000:00000024:2.0:1788651776.482936:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651776.482968:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147516544:12345-0@lo:13: Request processed in 79us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651776.482974:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1788651776.482998:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a58a80 x1875537147516544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651776.483010:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147516544:0@lo:13: 00000001:00100000:2.0:1788651777.003683:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000001:00100000:0.0:1788651777.004050:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000100:00100000:1.0:1788651777.186602:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651777.186628:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651777.186660:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651777.186682:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651777.186709:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651777.186734:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125445760 00000100:00100000:1.0:1788651777.186743:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125445760 00000100:00100000:1.0:1788651777.186794:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125445888 00000100:00100000:1.0:1788651777.186797:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125445888 00000100:00100000:1.0:1788651777.186816:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:1.0:1788651777.186826:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125445760:12345-192.168.204.45@tcp:400: 00000100:00100000:1.0:1788651777.186891:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125445760:12345-192.168.204.45@tcp:400: Request processed in 67us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651777.186898:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:1.0:1788651777.186934:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:1.0:1788651777.186942:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125445888:12345-192.168.204.45@tcp:400: 00000100:00100000:1.0:1788651777.186967:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125445888:12345-192.168.204.45@tcp:400: Request processed in 27us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651777.186990:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:1.0:1788651777.187010:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125446016 00000100:00100000:1.0:1788651777.187014:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125446016 00000100:00100000:1.0:1788651777.187039:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125446144 00000100:00100000:1.0:1788651777.187042:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125446144 00000100:00100000:1.0:1788651777.187060:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:1.0:1788651777.187067:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125446016:12345-192.168.204.45@tcp:400: 00000100:00100000:1.0:1788651777.187093:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125446016:12345-192.168.204.45@tcp:400: Request processed in 27us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651777.187099:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:1.0:1788651777.187111:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:1.0:1788651777.187117:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125446144:12345-192.168.204.45@tcp:400: 00000100:00100000:1.0:1788651777.187140:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125446144:12345-192.168.204.45@tcp:400: Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651777.187146:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00080000:1.0:1788651777.187161:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651777.187164:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651777.187167:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788651777.187169:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651777.187193:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125445632 00000100:00100000:0.0:1788651777.187197:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125445632 00000100:00100000:0.0:1788651777.187230:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 200 00000100:00100000:0.0:1788651777.187237:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2390:x1875537125445632:12345-192.168.204.45@tcp:400: 00000100:00100000:0.0:1788651777.187262:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2390:x1875537125445632:12345-192.168.204.45@tcp:400: Request processed in 27us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651777.187268:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 200 00000001:02000400:1.0:1788651777.375679:0:10178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788651777.505049:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788651777.506996:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651777.508977:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147516672:0@lo:41: 00000100:00100000:1.0:1788651777.509066:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651777.509294:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147516672 00000100:00100000:0.0:1788651777.509304:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147516672 00000100:00100000:0.0:1788651777.509440:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788651777.509452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147516672:12345-0@lo:41: 00000004:00000024:0.0:1788651777.509487:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788651777.509535:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147516672:12345-0@lo:41: Request processed in 85us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651777.509552:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788651777.510353:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147516672:0@lo:41: 00000001:00100000:0.0:1788651778.020360:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00010000:00010000:0.0:1788651778.528024:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651779.045517:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651779.045544:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147516800:0@lo:41: 00000100:00100000:0.0:1788651779.045620:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651779.045694:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147516800 00000100:00100000:0.0:1788651779.045703:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147516800 00000100:00100000:0.0:1788651779.045754:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788651779.045763:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147516800:12345-0@lo:41: 00000004:00000024:0.0:1788651779.045799:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788651779.045847:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147516800:12345-0@lo:41: Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651779.045854:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788651779.045898:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147516800:0@lo:41: 00010000:00010000:0.0:1788651779.553064:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651780.576113:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651780.576141:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147517312:0@lo:400: 00000100:00100000:2.0:1788651780.576220:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147517184:0@lo:400: 00000100:00100000:3.0:1788651780.576226:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651780.576266:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651780.576294:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147517696:0@lo:400: 00000100:00100000:3.0:1788651780.576306:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147517056:0@lo:13: 00000100:00100000:2.0:1788651780.576315:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651780.576351:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651780.576356:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147518208:0@lo:400: 00000100:00100000:3.0:1788651780.576385:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147517824:0@lo:400: 00000100:00100000:2.0:1788651780.576391:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651780.576418:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651780.576418:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1788651780.576428:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147516928:0@lo:400: 00000100:00100000:3.0:1788651780.576441:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147518336:0@lo:400: 00000100:00100000:0.0:1788651780.576538:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147517440:0@lo:400: 00000100:00100000:1.0:1788651780.576622:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147517184 00000100:00100000:1.0:1788651780.576642:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147517184 00000100:00100000:1.0:1788651780.576702:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147517696 00000100:00100000:1.0:1788651780.576706:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147517696 00000100:00100000:1.0:1788651780.576729:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147518208 00000100:00100000:1.0:1788651780.576732:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147518208 00000100:00100000:1.0:1788651780.576746:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147517824 00000100:00100000:1.0:1788651780.576749:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147517824 00000100:00100000:1.0:1788651780.576765:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788651780.576773:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147517184:12345-0@lo:400: 00000100:00100000:3.0:1788651780.578724:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651780.581123:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147517312 00000100:00100000:3.0:1788651780.581139:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147517312 00000100:00100000:3.0:1788651780.581231:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788651780.581242:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147517312:12345-0@lo:400: 00000100:00100000:3.0:1788651780.581378:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147517312:12345-0@lo:400: Request processed in 138us (5154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651780.581386:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788651780.581413:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147517056 00000100:00100000:3.0:1788651780.581418:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147517056 00000100:00100000:3.0:1788651780.581452:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788651780.581459:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147517056:12345-0@lo:13: 00002000:00000024:3.0:1788651780.581485:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651780.581518:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2831f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147517056:12345-0@lo:13: Request processed in 60us (5169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651780.582122:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788651780.582149:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147518336 00000100:00100000:3.0:1788651780.582154:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147518336 00000100:00100000:3.0:1788651780.582181:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788651780.582189:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147517696:12345-0@lo:400: 00000100:00100000:3.0:1788651780.582231:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147517696:12345-0@lo:400: Request processed in 43us (5916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651780.582843:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788651780.582868:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788651780.582878:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147518208:12345-0@lo:400: 00000100:00100000:3.0:1788651780.582941:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147518208:12345-0@lo:400: Request processed in 66us (6553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651780.582947:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788651780.582958:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788651780.582964:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147517824:12345-0@lo:400: 00000100:00100000:3.0:1788651780.582989:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147517824:12345-0@lo:400: Request processed in 26us (6573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651780.583008:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788651780.583020:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788651780.583025:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147518336:12345-0@lo:400: 00000100:00100000:3.0:1788651780.583052:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147518336:12345-0@lo:400: Request processed in 27us (4335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651780.583058:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788651780.583075:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788651780.583108:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a59f80 x1875537147517824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651780.583124:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147517824:0@lo:400: 00000100:00100000:2.0:1788651780.583135:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147517568:0@lo:400: 00010000:00080000:3.0:1788651780.583139:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5ad80 x1875537147518336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651780.583150:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147518336:0@lo:400: 00000100:00100000:3.0:1788651780.583167:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147517312:0@lo:400: 00010000:00080000:3.0:1788651780.583182:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2830700 x1875537147517056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651780.583185:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651780.583205:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147517056:0@lo:13: 00000100:00100000:2.0:1788651780.583215:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147518080:0@lo:400: 00000100:00100000:2.0:1788651780.583241:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651780.583269:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147518592:0@lo:400: 00000100:00100000:3.0:1788651780.583287:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147516928 00000100:00100000:2.0:1788651780.583295:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651780.583307:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147516928 00000100:00100000:2.0:1788651780.583335:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147517696:0@lo:400: 00000100:00100000:3.0:1788651780.583357:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788651780.583360:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147518208:0@lo:400: 00000100:00100000:3.0:1788651780.583370:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147516928:12345-0@lo:400: 00000100:00100000:2.0:1788651780.583391:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147517568 00000100:00100000:2.0:1788651780.583395:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147517568 00000100:00100000:3.0:1788651780.583417:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147516928:12345-0@lo:400: Request processed in 50us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651780.583424:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788651780.583429:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788651780.583440:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147517568:12345-0@lo:400: 00000100:00100000:2.0:1788651780.583481:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147517568:12345-0@lo:400: Request processed in 43us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651780.583485:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147518080 00000100:00100000:2.0:1788651780.583489:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788651780.583490:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147518080 00000100:00100000:2.0:1788651780.583532:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147516928:0@lo:400: 00000100:00100000:3.0:1788651780.583542:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147518592 00000100:00100000:2.0:1788651780.583543:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147517568:0@lo:400: 00000100:00100000:3.0:1788651780.583547:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147518592 00000100:00100000:3.0:1788651780.583571:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788651780.583578:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147518080:12345-0@lo:400: 00000100:00100000:3.0:1788651780.583609:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147518080:12345-0@lo:400: Request processed in 32us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651780.583616:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788651780.583626:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788651780.583632:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147518592:12345-0@lo:400: 00000100:00100000:3.0:1788651780.583657:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147518592:12345-0@lo:400: Request processed in 25us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651780.583662:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788651780.583710:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651780.583714:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651780.583717:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651780.583719:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788651780.583810:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651780.583839:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651780.583862:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147517440 00000100:00100000:0.0:1788651780.583865:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147517440 00000100:00100000:0.0:1788651780.583889:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788651780.583896:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147517440:12345-0@lo:400: 00000100:00100000:0.0:1788651780.583940:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147517440:12345-0@lo:400: Request processed in 44us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651780.583946:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788651780.583979:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147517440:0@lo:400: 00000100:00100000:0.0:1788651780.583987:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147517952:0@lo:400: 00000100:00100000:0.0:1788651780.584011:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651780.584028:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147517952 00000100:00100000:0.0:1788651780.584031:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147517952 00000100:00100000:0.0:1788651780.584056:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788651780.584062:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147517952:12345-0@lo:400: 00000100:00100000:0.0:1788651780.584088:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147517952:12345-0@lo:400: Request processed in 27us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651780.584094:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1788651780.584107:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788651780.584121:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a59880 x1875537147517952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651780.584130:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147517952:0@lo:400: 00000100:00100000:0.0:1788651780.584137:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147518464:0@lo:400: 00000100:00100000:0.0:1788651780.584157:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651780.584175:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147518464 00000100:00100000:0.0:1788651780.584178:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147518464 00000100:00100000:0.0:1788651780.584198:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788651780.584203:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147518464:12345-0@lo:400: 00000100:00100000:0.0:1788651780.584228:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147518464:12345-0@lo:400: Request processed in 25us (70us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651780.584234:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788651780.584256:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a58700 x1875537147518464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651780.584265:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147518464:0@lo:400: 00010000:00080000:0.0:1788651780.585177:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5aa00 x1875537147518080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651780.585190:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147518080:0@lo:400: 00010000:00080000:0.0:1788651780.585202:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5b800 x1875537147518592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651796 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651780.585209:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147518592:0@lo:400: 00000100:00100000:1.0:1788651780.585357:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147517184:12345-0@lo:400: Request processed in 8583us (9089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651780.585366:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788651780.585453:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147517184:0@lo:400: 00000100:00100000:0.0:1788651780.588408:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147518720:0@lo:13: 00000100:00100000:0.0:1788651780.588480:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651780.589618:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147518720 00000100:00100000:3.0:1788651780.589643:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147518720 00000100:00100000:3.0:1788651780.589703:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788651780.589712:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147518720:12345-0@lo:13: 00002000:00000024:3.0:1788651780.589735:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651780.589807:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147518720:12345-0@lo:13: Request processed in 96us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651780.589815:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:2.0:1788651780.590109:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d6680 x1875537147518720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651796 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651780.590130:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147518720:0@lo:13: 00000020:00000080:3.0:1788651781.405985:0:10325:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1ef1e720 20000000:00000080:3.0:1788651781.406003:0:10325:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f85c2a5d400 uarg=0000000000000000 20000000:01000000:3.0:1788651781.406054:0:10325:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788651781.406060:0:10325:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788651781.406063:0:10325:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788651781.406069:0:10325:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788651781.406073:0:10325:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788651781.406393:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788651781.406396:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788651781.407559:0:10326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:0.0:1788651781.407885:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:0.0:1788651781.408464:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:0.0:1788651781.408484:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:0.0:1788651781.408495:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788651781.408498:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788651781.408940:0:10327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:0.0:1788651781.409257:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:0.0:1788651781.409284:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:0.0:1788651781.409299:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:0.0:1788651781.409322:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788651781.409325:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788651781.409876:0:10328:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:0.0:1788651781.410419:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:0.0:1788651781.410443:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:0.0:1788651781.410457:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:0.0:1788651781.410465:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788651781.410467:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788651781.410889:0:10329:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:0.0:1788651781.411261:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:0.0:1788651781.411282:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:0.0:1788651781.411297:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:0.0:1788651781.411319:0:10325:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788651781.411328:0:10325:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788651781.411600:0:10330:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:0.0:1788651781.411815:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:0.0:1788651781.411837:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:0.0:1788651781.411872:0:10325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 10000000:01000000:0.0:1788651781.411888:0:10325:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788651781.412379:0:10325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412400:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3abf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ab8 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412409:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ae2 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412416:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3b28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b21 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412423:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3b36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b2f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412431:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b3d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412438:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b59 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412446:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f85c23dd800/0xcd2f56ea038c3b8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b83 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412453:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3ba6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3b9f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412472:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c3bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3bc2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412482:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ab3 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412490:0:10325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c3be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aba expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412498:0:10325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412538:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c3be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aba expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412555:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c3be5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aba expref: 9 pid: 6505 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.412570:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147518848:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651781.412791:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ab3 expref: 9 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412800:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3bde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ab3 expref: 9 pid: 6504 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.412810:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147518976:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651781.412841:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c3bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3bc2 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412860:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c3bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3bc2 expref: 23 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.412871:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519104:0@lo:104: 00000100:00100000:0.0:1788651781.412946:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651781.412982:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3b9f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.412989:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b9f expref: 23 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.412997:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519232:0@lo:104: 00000100:00100000:0.0:1788651781.413017:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651781.413053:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f85c23dd800/0xcd2f56ea038c3b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3b83 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.413061:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f85c23dd800/0xcd2f56ea038c3b8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b83 expref: 23 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.413068:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519360:0@lo:104: 00000100:00100000:0.0:1788651781.413087:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651781.413104:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3b59 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.413231:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3b60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b59 expref: 23 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.413241:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519488:0@lo:104: 00000100:00100000:0.0:1788651781.413274:0:10325:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651781.413292:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3b3d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.413310:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b3d expref: 23 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.413323:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519616:0@lo:104: 00010000:00010000:0.0:1788651781.413349:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3b2f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.413356:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3b36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b2f expref: 23 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.413362:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519744:0@lo:104: 00010000:00010000:0.0:1788651781.413395:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3b21 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.413402:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b21 expref: 23 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.413409:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519872:0@lo:104: 00010000:00010000:0.0:1788651781.413433:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3ae2 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.413439:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ae9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ae2 expref: 23 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.413446:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147520000:0@lo:104: 00010000:00010000:0.0:1788651781.413475:0:10325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3abf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3ab8 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.413487:0:10325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3abf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ab8 expref: 23 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.413496:0:10325:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147520128:0@lo:104: 00000100:00100000:0.0:1788651781.413517:0:10325:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2d329c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651781.413700:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788651781.413720:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.413731:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.413740:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.413748:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.413756:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.413764:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147519104 00000100:00100000:2.0:1788651781.413771:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147519104 00000100:00100000:2.0:1788651781.413808:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147519232 00000100:00100000:2.0:1788651781.413811:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147519232 00000100:00100000:2.0:1788651781.413831:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147519360 00000100:00100000:2.0:1788651781.413834:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147519360 00000100:00100000:2.0:1788651781.413842:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147519488 00000100:00100000:2.0:1788651781.413844:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147519488 00000100:00100000:2.0:1788651781.413852:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147519616 00000100:00100000:2.0:1788651781.413854:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147519616 00000100:00100000:2.0:1788651781.413861:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147519744 00000100:00100000:2.0:1788651781.413863:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147519744 00000100:00100000:2.0:1788651781.413870:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147519872 00000100:00100000:2.0:1788651781.413872:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147519872 00000100:00100000:2.0:1788651781.413880:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147520000 00000100:00100000:2.0:1788651781.413882:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147520000 00000100:00100000:2.0:1788651781.413890:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147520128 00000100:00100000:2.0:1788651781.413892:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147520128 00000100:00100000:2.0:1788651781.413904:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788651781.413931:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:10325:x1875537147519104:12345-0@lo:104: 00010000:00010000:2.0:1788651781.413943:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.413997:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788651781.414004:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+11:10325:x1875537147519104:12345-0@lo:104: Request processed in 76us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.414011:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788651781.414206:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519104:0@lo:104: 00000100:00100000:2.0:1788651781.414252:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788651781.414260:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:10325:x1875537147519232:12345-0@lo:104: 00010000:00010000:2.0:1788651781.414269:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.414326:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788651781.414331:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+10:10325:x1875537147519232:12345-0@lo:104: Request processed in 74us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.414347:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788651781.414359:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788651781.414365:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+9:10325:x1875537147519360:12345-0@lo:104: 00010000:00010000:2.0:1788651781.414373:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.414408:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788651781.414413:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+9:10325:x1875537147519360:12345-0@lo:104: Request processed in 49us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.414419:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788651781.414429:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788651781.414434:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6775850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+8:10325:x1875537147519488:12345-0@lo:104: 00010000:00010000:2.0:1788651781.414442:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.414466:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788651781.414470:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6775850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+8:10325:x1875537147519488:12345-0@lo:104: Request processed in 37us (1197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.414476:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788651781.414504:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788651781.414509:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+7:10325:x1875537147519616:12345-0@lo:104: 00010000:00010000:2.0:1788651781.414516:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.414541:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788651781.414545:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+7:10325:x1875537147519616:12345-0@lo:104: Request processed in 37us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.414556:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788651781.414568:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788651781.414574:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:10325:x1875537147519744:12345-0@lo:104: 00010000:00010000:2.0:1788651781.414582:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.414608:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788651781.414613:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:10325:x1875537147519744:12345-0@lo:104: Request processed in 41us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.414808:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788651781.414821:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788651781.414827:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:10325:x1875537147519872:12345-0@lo:104: 00010000:00010000:2.0:1788651781.414836:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.414863:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788651781.414868:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:10325:x1875537147519872:12345-0@lo:104: Request processed in 42us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.414873:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788651781.414884:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788651781.414889:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:10325:x1875537147520000:12345-0@lo:104: 00010000:00010000:2.0:1788651781.414896:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.414978:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1788651781.414983:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:10325:x1875537147520000:12345-0@lo:104: Request processed in 94us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.414995:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788651781.415006:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788651781.415011:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:10325:x1875537147520128:12345-0@lo:104: 00010000:00010000:2.0:1788651781.415019:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.415194:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519232:0@lo:104: 00000100:00100000:0.0:1788651781.415202:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519360:0@lo:104: 00000100:00100000:0.0:1788651781.415209:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519488:0@lo:104: 00000100:00100000:0.0:1788651781.415216:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519616:0@lo:104: 00000100:00100000:0.0:1788651781.415222:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519744:0@lo:104: 00000100:00100000:0.0:1788651781.415228:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147519872:0@lo:104: 00000100:00100000:0.0:1788651781.415236:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147520000:0@lo:104: 00010000:00010000:2.0:1788651781.415366:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1788651781.415372:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:10325:x1875537147520128:12345-0@lo:104: Request processed in 361us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.415377:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788651781.415403:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788651781.415409:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415417:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651781.415421:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415428:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651781.415436:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651781.415442:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651781.415481:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415488:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651781.415512:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415519:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c3bc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3bc9 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415532:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788651781.415535:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415542:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651781.415545:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415551:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651781.415557:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651781.415562:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651781.415575:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415581:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651781.415586:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415591:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3b9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3ba6 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415599:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788651781.415607:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415613:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dcc00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651781.415689:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415697:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651781.415702:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651781.415706:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651781.415721:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415726:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651781.415743:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415749:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c23dcc00/0xcd2f56ea038c3b83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b8a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415756:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788651781.415759:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415764:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651781.415767:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415783:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651781.415789:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651781.415794:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651781.415809:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415814:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651781.415819:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415824:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c23dc400/0xcd2f56ea038c3b59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b60 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415832:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788651781.415835:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415840:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651781.415842:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415848:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651781.415853:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651781.415863:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651781.415878:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415883:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651781.415887:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415892:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c3b3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b44 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415898:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788651781.415901:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415936:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651781.415940:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415946:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651781.415951:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651781.415955:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651781.415967:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415973:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651781.415982:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415987:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3b2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b36 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.415996:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788651781.415999:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416005:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651781.416007:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416013:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651781.416019:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651781.416093:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651781.416171:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416178:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651781.416183:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416188:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3b21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3b28 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416199:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788651781.416209:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416215:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651781.416218:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416224:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651781.416230:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651781.416235:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651781.416250:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416256:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651781.416260:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416265:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4e00/0xcd2f56ea038c3ae2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3ae9 expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416273:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651781.416276:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416282:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23ddc00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788651781.416284:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416300:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788651781.416317:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788651781.416321:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788651781.416333:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416338:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788651781.416342:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416347:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c23ddc00/0xcd2f56ea038c3ab8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3abf expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.416358:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651781.416359:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651781.416361:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651781.416370:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651781.416376:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651781.416389:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147520256:0@lo:103: 00000100:00100000:2.0:1788651781.416432:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.416469:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147520768:0@lo:103: 00000100:00100000:2.0:1788651781.416487:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.416502:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147521280:0@lo:103: 00000100:00100000:2.0:1788651781.416529:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.416555:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788651781.416561:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147520384:0@lo:103: 00000100:00100000:2.0:1788651781.416580:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.416596:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147520896:0@lo:103: 00000100:00100000:2.0:1788651781.416612:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.416888:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147520512:0@lo:103: 00000100:00100000:3.0:1788651781.416960:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147520256 00000100:00100000:3.0:1788651781.416968:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147520256 00010000:00010000:3.0:1788651781.416999:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c3bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3bc2 expref: 24 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651781.417017:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147520768 00000100:00100000:3.0:1788651781.417020:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147520768 00010000:00010000:3.0:1788651781.417042:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b3d expref: 25 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651781.417053:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147521280 00000100:00100000:3.0:1788651781.417056:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147521280 00010000:00010000:3.0:1788651781.417066:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3abf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ab8 expref: 26 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651781.417075:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147520384 00000100:00100000:3.0:1788651781.417077:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147520384 00010000:00010000:3.0:1788651781.417087:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b9f expref: 27 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651781.417097:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147520896 00000100:00100000:3.0:1788651781.417099:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147520896 00010000:00010000:3.0:1788651781.417120:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3b36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b2f expref: 28 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651781.417133:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788651781.417149:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+28:3635:x1875537147520256:12345-0@lo:103: 00010000:00010000:3.0:1788651781.417160:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651781.417165:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c3bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3bc2 expref: 28 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417175:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c3bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3bc2 expref: 28 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417189:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5400/0xcd2f56ea038c3bc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3bc2 expref: 28 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417201:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651781.417237:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+27:3635:x1875537147520256:12345-0@lo:103: Request processed in 89us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651781.417244:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788651781.417285:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788651781.417292:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+26:3635:x1875537147520768:12345-0@lo:103: 00010000:00010000:3.0:1788651781.417299:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651781.417322:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b3d expref: 26 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417331:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b3d expref: 26 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417341:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c1503200/0xcd2f56ea038c3b44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3b3d expref: 26 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417350:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651781.417374:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+25:3635:x1875537147520768:12345-0@lo:103: Request processed in 82us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651781.417389:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788651781.417401:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651781.417407:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147521280:12345-0@lo:103: 00010000:00010000:3.0:1788651781.417414:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651781.417418:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3abf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ab8 expref: 24 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417425:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3abf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ab8 expref: 24 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417434:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651781.417454:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147521280:12345-0@lo:103: Request processed in 48us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651781.417460:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651781.417471:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788651781.417477:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:3635:x1875537147520384:12345-0@lo:103: 00010000:00010000:3.0:1788651781.417483:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651781.417488:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3ba6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b9f expref: 23 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417496:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3ba6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b9f expref: 23 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417505:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3ba6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3b9f expref: 23 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417514:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651781.417534:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3635:x1875537147520384:12345-0@lo:103: Request processed in 58us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651781.417545:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788651781.417557:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788651781.417563:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3635:x1875537147520896:12345-0@lo:103: 00010000:00010000:3.0:1788651781.417571:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651781.417575:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3b36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b2f expref: 21 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417583:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b2f expref: 21 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417594:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3b36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3b2f expref: 21 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.417602:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651781.418033:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.418061:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147521024:0@lo:103: 00000100:00100000:2.0:1788651781.418084:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.418097:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788651781.418103:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147520640:0@lo:103: 00000100:00100000:2.0:1788651781.418136:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.418146:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147521152:0@lo:103: 00000100:00100000:2.0:1788651781.418163:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651781.418187:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147520512 00000100:00100000:2.0:1788651781.418191:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147520512 00010000:00010000:2.0:1788651781.418210:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f85c23dd800/0xcd2f56ea038c3b8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b83 expref: 21 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651781.418225:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147521024 00000100:00100000:2.0:1788651781.418228:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147521024 00010000:00010000:2.0:1788651781.418237:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b21 expref: 22 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651781.418247:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147520640 00000100:00100000:2.0:1788651781.418249:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147520640 00010000:00010000:2.0:1788651781.418279:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3b60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b59 expref: 23 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651781.418298:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147521152 00000100:00100000:2.0:1788651781.418311:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147521152 00010000:00010000:2.0:1788651781.418323:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ae9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ae2 expref: 24 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651781.418335:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788651781.418340:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147520512:12345-0@lo:103: 00010000:00010000:2.0:1788651781.418348:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651781.418351:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f85c23dd800/0xcd2f56ea038c3b8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b83 expref: 24 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418359:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f85c23dd800/0xcd2f56ea038c3b8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b83 expref: 24 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418369:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dd800/0xcd2f56ea038c3b8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3b83 expref: 24 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418377:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651781.418406:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:3637:x1875537147520512:12345-0@lo:103: Request processed in 66us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.418412:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788651781.418425:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788651781.418430:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3637:x1875537147521024:12345-0@lo:103: 00010000:00010000:2.0:1788651781.418437:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651781.418441:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3b28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b21 expref: 22 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418448:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b21 expref: 22 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418463:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3b28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3b21 expref: 22 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418472:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651781.418496:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3637:x1875537147521024:12345-0@lo:103: Request processed in 66us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.418502:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788651781.418515:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788651781.418526:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:3637:x1875537147520640:12345-0@lo:103: 00010000:00010000:2.0:1788651781.418535:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651781.418539:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3b60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b59 expref: 20 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418548:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3b59 expref: 20 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418557:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3b60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3b59 expref: 20 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418565:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651781.418585:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:3637:x1875537147520640:12345-0@lo:103: Request processed in 65us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.418591:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788651781.418602:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788651781.418608:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:3637:x1875537147521152:12345-0@lo:103: 00010000:00010000:2.0:1788651781.418625:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651781.418630:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ae9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ae2 expref: 18 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418644:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ae9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ae2 expref: 18 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418654:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ae9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3ae2 expref: 18 pid: 6504 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651781.418662:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651781.418685:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:3637:x1875537147521152:12345-0@lo:103: Request processed in 77us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651781.418690:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788651781.418726:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147520384:0@lo:103: 00000100:00100000:2.0:1788651781.418735:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147520256:0@lo:103: 00000100:00100000:2.0:1788651781.418742:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147520768:0@lo:103: 00000100:00100000:2.0:1788651781.418749:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147521280:0@lo:103: 00000100:00100000:2.0:1788651781.418777:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147520640:0@lo:103: 00000100:00100000:2.0:1788651781.418784:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147521152:0@lo:103: 00000100:00100000:2.0:1788651781.418791:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147520512:0@lo:103: 00000100:00100000:2.0:1788651781.418798:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147521024:0@lo:103: 00000100:00100000:3.0:1788651781.419272:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:3635:x1875537147520896:12345-0@lo:103: Request processed in 1707us (2656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651781.419278:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788651781.419377:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147520896:0@lo:103: 00000100:00100000:1.0:1788651781.428267:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651781.428396:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651781.429011:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125446400 00000100:00100000:3.0:1788651781.429088:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125446400 00010000:00010000:3.0:1788651781.429192:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3bde lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ab3 expref: 10 pid: 6504 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651781.429225:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125446272 00000100:00100000:3.0:1788651781.429228:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125446272 00010000:00010000:3.0:1788651781.429240:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c3be5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aba expref: 11 pid: 6505 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651781.429258:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:3.0:1788651781.429267:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:2389:x1875537125446400:12345-192.168.204.45@tcp:103: 00010000:00010000:3.0:1788651781.429295:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651781.429313:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3bde lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ab3 expref: 11 pid: 6504 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429323:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3bde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ab3 expref: 11 pid: 6504 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429342:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651781.429394:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:2389:x1875537125446400:12345-192.168.204.45@tcp:103: Request processed in 128us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651781.429401:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:3.0:1788651781.429423:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:3.0:1788651781.429430:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2388:x1875537125446272:12345-192.168.204.45@tcp:103: 00010000:00010000:3.0:1788651781.429439:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651781.429443:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c3be5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aba expref: 10 pid: 6505 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429453:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c3be5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aba expref: 10 pid: 6505 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429466:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429473:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429486:0:6495:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429502:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429508:0:6495:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429514:0:6495:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429520:0:6495:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788651781.429525:0:6495:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429532:0:6495:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429540:0:6495:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651781.429549:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651781.429568:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2388:x1875537125446272:12345-192.168.204.45@tcp:103: Request processed in 139us (1173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651781.429574:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 34 00010000:00010000:0.0:1788651781.431788:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3abf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3ab8 expref: 15 pid: 6505 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.431809:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147520128:0@lo:104: 00010000:00010000:0.0:1788651781.431830:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dc800/0xcd2f56ea038c3be5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aba expref: 9 pid: 6505 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.431839:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147518848:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651781.431850:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3bde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ab3 expref: 8 pid: 6504 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651781.431860:0:10325:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10325:1875537147518976:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651781.431933:0:10325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.431942:0:10325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.431948:0:10325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651781.431954:0:10325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c24 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651781.600229:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651781.601524:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147521408:0@lo:13: 00000100:00100000:3.0:1788651781.601597:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651781.601807:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147521408 00000100:00100000:1.0:1788651781.601818:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147521408 00000100:00100000:1.0:1788651781.601877:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788651781.601886:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147521408:12345-0@lo:13: 00002000:00000024:1.0:1788651781.601937:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651781.601988:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147521408:12345-0@lo:13: Request processed in 103us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651781.601995:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788651781.602254:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c345aa00 x1875537147521408/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651781.602273:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147521408:0@lo:13: 00000100:00100000:1.0:1788651781.603871:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147521536:0@lo:13: 00000100:00100000:1.0:1788651781.603954:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651781.604139:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651781.604291:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147521536 00000100:00100000:1.0:1788651781.604315:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147521536 00000100:00100000:1.0:1788651781.604410:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788651781.604418:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147521536:12345-0@lo:13: 00002000:00000024:1.0:1788651781.604439:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651781.604493:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147521536:12345-0@lo:13: Request processed in 76us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651781.604500:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788651781.604565:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3458e00 x1875537147521536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651781.604584:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147521536:0@lo:13: 00000100:00100000:1.0:1788651782.310558:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651782.310619:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651782.310666:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651782.310692:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651782.310717:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651782.310996:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125446912 00000100:00100000:0.0:1788651782.311008:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125446912 00000100:00100000:3.0:1788651782.311023:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125446656 00000100:00100000:3.0:1788651782.311027:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125446656 00000100:00100000:0.0:1788651782.311133:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125447040 00000100:00100000:0.0:1788651782.311138:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125447040 00000100:00100000:2.0:1788651782.311229:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125446784 00000100:00100000:2.0:1788651782.311233:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125446784 00000100:00100000:3.0:1788651782.315926:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 66 00000100:00100000:3.0:1788651782.315961:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125446656:12345-192.168.204.45@tcp:400: 00000100:00100000:3.0:1788651782.316045:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125446656:12345-192.168.204.45@tcp:400: Request processed in 92us (5497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651782.316051:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 66 00000100:00100000:3.0:1788651782.316194:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125446528 00000100:00100000:3.0:1788651782.316202:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125446528 00000100:00100000:3.0:1788651782.316228:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 202 00000100:00100000:3.0:1788651782.316234:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:2389:x1875537125446528:12345-192.168.204.45@tcp:400: 00000100:00100000:3.0:1788651782.316266:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:2389:x1875537125446528:12345-192.168.204.45@tcp:400: Request processed in 31us (5600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651782.316272:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 202 00000100:00100000:3.0:1788651782.316328:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:3.0:1788651782.316336:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125446912:12345-192.168.204.45@tcp:400: 00000100:00100000:3.0:1788651782.316358:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125446912:12345-192.168.204.45@tcp:400: Request processed in 25us (5752us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651782.316364:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00080000:1.0:1788651782.323132:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788651782.323163:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651782.323167:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651782.323170:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651782.323430:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:0.0:1788651782.323459:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125447040:12345-192.168.204.45@tcp:400: 00000100:00100000:0.0:1788651782.323541:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125447040:12345-192.168.204.45@tcp:400: Request processed in 90us (12822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651782.323548:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:2.0:1788651782.331155:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00100000:2.0:1788651782.331175:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125446784:12345-192.168.204.45@tcp:400: 00000100:00100000:2.0:1788651782.331263:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125446784:12345-192.168.204.45@tcp:400: Request processed in 96us (20569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651782.331271:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 67 00010000:00010000:2.0:1788651782.624112:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651782.624486:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147521664:0@lo:41: 00000100:00100000:2.0:1788651782.624553:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651782.626487:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147521664 00000100:00100000:0.0:1788651782.626502:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147521664 00000100:00100000:0.0:1788651782.626695:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788651782.626706:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147521664:12345-0@lo:41: 00000004:00000024:0.0:1788651782.626743:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788651782.626825:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147521664:12345-0@lo:41: Request processed in 121us (2271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651782.626850:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788651782.626960:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147521664:0@lo:41: 10000000:01000000:3.0:1788651783.456031:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788651783.456039:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f85c196d800 from 48 10000000:01000000:3.0:1788651783.456044:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788651783.456106:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.456118:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.456156:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651783.456181:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147521792:0@lo:101: 00000100:00100000:3.0:1788651783.456252:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.456339:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4a47c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.456439:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147521792 00000100:00100000:0.0:1788651783.456447:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147521792 00000100:00100000:0.0:1788651783.456505:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788651783.456515:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+15:6507:x1875537147521792:12345-0@lo:101: 00010000:00010000:0.0:1788651783.456527:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651783.456543:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3c32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3c2b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.456565:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c2b expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.456582:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3c32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c2b expref: 16 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.456591:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5600, rc 0) 00000100:00100000:0.0:1788651783.456641:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147521792:12345-0@lo:101: Request processed in 128us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.456648:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788651783.459286:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaece00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147521792:0@lo:101: 00010000:00010000:1.0:1788651783.459319:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.459333:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651783.459450:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147521920:0@lo:501: 00000100:00100000:1.0:1788651783.459505:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.459556:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788651783.460259:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147521920 00000100:00100000:3.0:1788651783.460275:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147521920 00000100:00100000:3.0:1788651783.460330:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788651783.460339:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147521920:12345-0@lo:501: 00000100:00100000:3.0:1788651783.460479:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147521920:12345-0@lo:501: Request processed in 140us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651783.460487:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788651783.460735:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147521920:0@lo:501: 00000100:00100000:1.0:1788651783.460769:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147522048:0@lo:503: 00000100:00100000:1.0:1788651783.460823:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.460854:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788651783.462255:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147522048 00000100:00100000:3.0:1788651783.462277:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147522048 00000100:00100000:3.0:1788651783.462340:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788651783.462350:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147522048:12345-0@lo:503: 00000100:00100000:3.0:1788651783.462505:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147522048:12345-0@lo:503: Request processed in 156us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651783.462512:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788651783.462788:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147522048:0@lo:503: 00000100:00100000:2.0:1788651783.471746:0:10342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10342:1875537147522176:0@lo:502: 00000100:00100000:2.0:1788651783.471838:0:10342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651783.471968:0:10342:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.472450:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147522176 00000100:00100000:0.0:1788651783.472459:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147522176 00000100:00100000:0.0:1788651783.472517:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788651783.472527:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:10342:x1875537147522176:12345-0@lo:502: 00000100:00100000:0.0:1788651783.472698:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:10342:x1875537147522176:12345-0@lo:502: Request processed in 171us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.472706:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788651783.473027:0:10342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10342:1875537147522176:0@lo:502: 00000100:00100000:2.0:1788651783.473095:0:10342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10342:1875537147522304:0@lo:502: 00000100:00100000:2.0:1788651783.473137:0:10342:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651783.473172:0:10342:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db180 going to sleep for 11 seconds 00000100:00100000:3.0:1788651783.473810:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147522304 00000100:00100000:3.0:1788651783.473818:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147522304 00000100:00100000:3.0:1788651783.473874:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788651783.473883:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:10342:x1875537147522304:12345-0@lo:502: 00000100:00100000:3.0:1788651783.474050:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:10342:x1875537147522304:12345-0@lo:502: Request processed in 167us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651783.474068:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788651783.474250:0:10342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10342:1875537147522304:0@lo:502: 00000040:00080000:2.0:1788651783.474292:0:10342:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788651783.475293:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788651783.475324:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788651783.475337:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.475349:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651783.475359:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788651783.475361:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788651783.475365:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788651783.475399:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.475407:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.475417:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651783.475436:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147522432:0@lo:101: 00000100:00100000:3.0:1788651783.475484:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.475525:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.475956:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147522432 00000100:00100000:0.0:1788651783.475965:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147522432 00000100:00100000:0.0:1788651783.476370:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1788651783.476384:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+16:6507:x1875537147522432:12345-0@lo:101: 00010000:00010000:0.0:1788651783.476400:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651783.476415:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3c39 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.476444:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c39 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.476457:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c39 expref: 17 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.476467:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5a00, rc 0) 00000100:00100000:0.0:1788651783.476529:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147522432:12345-0@lo:101: Request processed in 149us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.476536:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788651783.476586:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaeed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147522432:0@lo:101: 00010000:00010000:1.0:1788651783.476604:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.476614:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651783.476682:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147522560:0@lo:501: 00000100:00100000:1.0:1788651783.476715:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.476739:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.477165:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147522560 00000100:00100000:2.0:1788651783.477172:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147522560 00000100:00100000:2.0:1788651783.477509:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788651783.477518:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147522560:12345-0@lo:501: 00000100:00100000:2.0:1788651783.477961:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147522560:12345-0@lo:501: Request processed in 443us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.477985:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1788651783.478463:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147522560:0@lo:501: 00000100:00100000:1.0:1788651783.478518:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147522688:0@lo:503: 00000100:00100000:1.0:1788651783.478568:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.478703:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788651783.478740:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147522688 00000100:00100000:3.0:1788651783.478747:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147522688 00000100:00100000:3.0:1788651783.478826:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788651783.478836:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147522688:12345-0@lo:503: 00000100:00100000:3.0:1788651783.479007:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147522688:12345-0@lo:503: Request processed in 173us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651783.479029:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1788651783.479307:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147522688:0@lo:503: 00000100:00100000:1.0:1788651783.479806:0:10343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10343:1875537147522816:0@lo:502: 00000100:00100000:1.0:1788651783.479847:0:10343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.479927:0:10343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.480442:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147522816 00000100:00100000:2.0:1788651783.480449:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147522816 00000100:00100000:2.0:1788651783.480488:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788651783.480497:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:10343:x1875537147522816:12345-0@lo:502: 00000100:00100000:2.0:1788651783.480833:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:10343:x1875537147522816:12345-0@lo:502: Request processed in 337us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.480840:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1788651783.482005:0:10343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10343:1875537147522816:0@lo:502: 00000020:01000000:1.0:1788651783.482431:0:10343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651783.482444:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651783.482447:0:10343:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788651783.482469:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788651783.482513:0:10343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10343:1875537147522944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651783.482765:0:10343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.482808:0:10343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.482870:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147522944 00000100:00100000:0.0:1788651783.482877:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147522944 00000100:00100000:0.0:1788651783.483207:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:0.0:1788651783.483219:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:10343:x1875537147522944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651783.483357:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:10343:x1875537147522944:12345-0@lo:502:llog_process_th.0 Request processed in 140us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.483365:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1788651783.483507:0:10343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10343:1875537147522944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788651783.483529:0:10343:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651783.483535:0:10343:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651783.483537:0:10343:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788651783.483541:0:10343:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:3.0:1788651783.483715:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788651783.483736:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788651783.483748:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.483759:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651783.483768:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788651783.483771:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86eeab9800 from 48 10000000:01000000:3.0:1788651783.483774:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788651783.483803:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.483812:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.483821:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651783.483840:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.483876:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.483931:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.484325:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147523072 00000100:00100000:0.0:1788651783.484331:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147523072 00000100:00100000:0.0:1788651783.484376:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788651783.484384:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+17:6507:x1875537147523072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651783.484395:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651783.484419:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3c4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3c47 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.484442:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c47 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.484452:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3c4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c47 expref: 18 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.484461:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4400, rc 0) 00000100:00100000:0.0:1788651783.484548:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147523072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.484555:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788651783.485354:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651783.485374:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.485385:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651783.485465:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.485505:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.485589:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef180 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.485685:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147523200 00000100:00100000:2.0:1788651783.485691:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147523200 00000100:00100000:2.0:1788651783.485784:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788651783.485795:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147523200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.485981:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147523200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.485989:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788651783.486111:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.486139:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.486181:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.487506:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.487666:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147523328 00000100:00100000:0.0:1788651783.487675:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147523328 00000100:00100000:0.0:1788651783.487720:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788651783.487729:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147523328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.487878:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147523328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.487886:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788651783.488421:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.488955:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10344:1875537147523456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651783.489007:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651783.489420:0:10344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.489471:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147523456 00000100:00100000:0.0:1788651783.489477:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147523456 00000100:00100000:0.0:1788651783.489519:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788651783.489526:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:10344:x1875537147523456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651783.489716:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:10344:x1875537147523456:12345-0@lo:502:llog_process_th.0 Request processed in 190us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.489725:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788651783.489814:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10344:1875537147523456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651783.489856:0:10344:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10344:1875537147523584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651783.489893:0:10344:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.489935:0:10344:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d28f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.489985:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147523584 00000100:00100000:0.0:1788651783.489995:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147523584 00000100:00100000:0.0:1788651783.490140:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788651783.490149:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:10344:x1875537147523584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651783.490536:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:10344:x1875537147523584:12345-0@lo:502:llog_process_th.0 Request processed in 387us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.490543:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788651783.490679:0:10344:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10344:1875537147523584:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788651783.490704:0:10344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788651783.490766:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788651783.490787:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788651783.490798:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.490808:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651783.490818:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788651783.490827:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788651783.490830:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788651783.490857:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.490865:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.490874:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651783.490888:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.490937:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.490960:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.491210:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147523712 00000100:00100000:0.0:1788651783.491216:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147523712 00000100:00100000:0.0:1788651783.491361:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788651783.491370:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+18:6507:x1875537147523712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651783.491380:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651783.491393:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4e00/0xcd2f56ea038c3c5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3c55 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.491416:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4e00/0xcd2f56ea038c3c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c55 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.491426:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da4e00/0xcd2f56ea038c3c5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c55 expref: 19 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.491435:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4e00, rc 0) 00000100:00100000:0.0:1788651783.491468:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147523712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.491474:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788651783.491506:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651783.491519:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.491538:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651783.491755:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.491780:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651783.491807:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.491854:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147523840 00000100:00100000:2.0:1788651783.491859:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147523840 00000100:00100000:2.0:1788651783.491894:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788651783.491901:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147523840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.492349:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147523840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.492358:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788651783.492446:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.492477:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.492514:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651783.492584:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651783.492726:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147523968 00000100:00100000:1.0:1788651783.492732:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147523968 00000100:00100000:3.0:1788651783.492779:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788651783.492788:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147523968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.492877:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147523968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651783.492884:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788651783.492989:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147523968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.493792:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10345:1875537147524096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651783.493841:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651783.493901:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db840 going to sleep for 11 seconds 00000100:00100000:3.0:1788651783.494149:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147524096 00000100:00100000:3.0:1788651783.494155:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147524096 00000100:00100000:3.0:1788651783.494332:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788651783.494342:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:10345:x1875537147524096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651783.494460:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:10345:x1875537147524096:12345-0@lo:502:llog_process_th.0 Request processed in 119us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651783.494468:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788651783.494822:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10345:1875537147524096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788651783.494850:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651783.494859:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651783.494863:0:10345:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788651783.494868:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788651783.494890:0:10345:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10345:1875537147524224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651783.495089:0:10345:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651783.495117:0:10345:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db840 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.495340:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147524224 00000100:00100000:0.0:1788651783.495346:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147524224 00000100:00100000:0.0:1788651783.495387:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788651783.495395:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:10345:x1875537147524224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651783.495490:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:10345:x1875537147524224:12345-0@lo:502:llog_process_th.0 Request processed in 96us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.495498:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788651783.495713:0:10345:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10345:1875537147524224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788651783.495734:0:10345:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651783.495739:0:10345:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651783.495741:0:10345:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788651783.495745:0:10345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:0.0:1788651783.496366:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788651783.496387:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788651783.496398:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.496410:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651783.496430:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788651783.496432:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86f48d9800 from 48 10000000:01000000:0.0:1788651783.496435:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788651783.496465:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.496474:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.496483:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651783.496500:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147524352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.496538:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651783.496569:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.496709:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147524352 00000100:00100000:2.0:1788651783.496714:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147524352 00000100:00100000:2.0:1788651783.496753:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788651783.496761:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:6507:x1875537147524352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651783.496771:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651783.496784:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23ddc00/0xcd2f56ea038c3c6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3c63 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651783.496805:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23ddc00/0xcd2f56ea038c3c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c63 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651783.496815:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23ddc00/0xcd2f56ea038c3c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c63 expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651783.496832:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23ddc00, rc 0) 00000100:00100000:2.0:1788651783.496865:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147524352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.496872:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788651783.499046:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147524352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651783.499073:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.499095:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651783.499178:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147524480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.499363:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651783.499478:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.499699:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147524480 00000100:00100000:2.0:1788651783.499706:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147524480 00000100:00100000:2.0:1788651783.499760:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788651783.499769:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147524480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.499902:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147524480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 133us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.499932:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788651783.500364:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147524480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.500417:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147524608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.500472:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651783.500536:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651783.500809:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147524608 00000100:00100000:3.0:1788651783.500815:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147524608 00000100:00100000:3.0:1788651783.500864:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788651783.500872:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147524608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.503592:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147524608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2703us (3102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651783.503607:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788651783.505767:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147524608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.506598:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10346:1875537147524736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651783.506738:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651783.506850:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280780 going to sleep for 11 seconds 00000100:00100000:1.0:1788651783.507255:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147524736 00000100:00100000:1.0:1788651783.507274:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147524736 00000100:00100000:1.0:1788651783.507333:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788651783.507343:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:10346:x1875537147524736:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651783.507492:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:10346:x1875537147524736:12345-0@lo:502:llog_process_th.0 Request processed in 149us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651783.507500:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788651783.507884:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10346:1875537147524736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651783.508512:0:10346:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10346:1875537147524864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651783.508565:0:10346:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651783.508656:0:10346:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280780 going to sleep for 11 seconds 00000100:00100000:3.0:1788651783.508837:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147524864 00000100:00100000:3.0:1788651783.508843:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147524864 00000100:00100000:3.0:1788651783.508888:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788651783.508896:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:10346:x1875537147524864:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651783.509600:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:10346:x1875537147524864:12345-0@lo:502:llog_process_th.0 Request processed in 703us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651783.509619:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788651783.509747:0:10346:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10346:1875537147524864:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788651783.509842:0:10346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788651783.510178:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1788651783.510588:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788651783.510600:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.510678:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651783.510690:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1788651783.510694:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:3.0:1788651783.510697:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788651783.510736:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.510743:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.510771:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651783.510862:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147524992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.511228:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.511289:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788651783.511535:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147524992 00000100:00100000:1.0:1788651783.511543:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147524992 00000100:00100000:1.0:1788651783.511697:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1788651783.511707:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147524992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651783.511720:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651783.511733:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff414600/0xcd2f56ea038c3c78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3c71 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.511756:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414600/0xcd2f56ea038c3c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c71 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.511782:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff414600/0xcd2f56ea038c3c78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c71 expref: 21 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.511790:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414600, rc 0) 00000100:00100000:1.0:1788651783.511852:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147524992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651783.511859:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788651783.511956:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147524992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651783.511973:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.511983:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651783.512065:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147525120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.512106:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.512810:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.512968:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147525120 00000100:00100000:2.0:1788651783.512974:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147525120 00000100:00100000:2.0:1788651783.513022:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788651783.513031:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147525120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.513179:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147525120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 148us (1072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.513187:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788651783.513538:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147525120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.513591:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147525248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.513639:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.513666:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.513900:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147525248 00000100:00100000:2.0:1788651783.513937:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147525248 00000100:00100000:2.0:1788651783.513963:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788651783.513969:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147525248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.514074:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147525248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.514092:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788651783.514503:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147525248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.518621:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10347:1875537147525376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651783.518717:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.518761:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788651783.518938:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147525376 00000100:00100000:1.0:1788651783.518946:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147525376 00000100:00100000:1.0:1788651783.518997:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788651783.519006:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:10347:x1875537147525376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651783.519137:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:10347:x1875537147525376:12345-0@lo:502:llog_process_th.0 Request processed in 132us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651783.519146:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788651783.519528:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10347:1875537147525376:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651783.519558:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651783.519568:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651783.519571:0:10347:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788651783.519577:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788651783.519598:0:10347:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10347:1875537147525504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651783.519720:0:10347:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.519754:0:10347:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788651783.519805:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147525504 00000100:00100000:1.0:1788651783.519810:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147525504 00000100:00100000:1.0:1788651783.519844:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788651783.519850:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:10347:x1875537147525504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651783.519955:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:10347:x1875537147525504:12345-0@lo:502:llog_process_th.0 Request processed in 104us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651783.519963:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788651783.520379:0:10347:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10347:1875537147525504:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651783.520474:0:10347:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651783.520480:0:10347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651783.520482:0:10347:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788651783.520486:0:10347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788651783.520641:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788651783.520662:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788651783.520671:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.520694:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651783.520706:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788651783.520708:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86da667000 from 48 10000000:01000000:1.0:1788651783.520711:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788651783.520737:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.520745:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.520753:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651783.520768:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147525632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651783.520802:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.520867:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.521468:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147525632 00000100:00100000:2.0:1788651783.521476:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147525632 00000100:00100000:2.0:1788651783.521525:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1788651783.521533:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147525632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651783.521544:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651783.521557:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dc400/0xcd2f56ea038c3c86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3c7f expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651783.521580:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dc400/0xcd2f56ea038c3c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c7f expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651783.521591:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dc400/0xcd2f56ea038c3c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c7f expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651783.521599:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc400, rc 0) 00000100:00100000:2.0:1788651783.521714:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147525632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.521721:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788651783.521793:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147525632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651783.521807:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.521816:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651783.521871:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147525760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651783.521898:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.521959:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.522720:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147525760 00000100:00100000:2.0:1788651783.522728:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147525760 00000100:00100000:2.0:1788651783.522770:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788651783.522901:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147525760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.523381:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147525760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 483us (1481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.523477:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147525760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.523517:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147525888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.523563:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651783.523595:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.523667:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788651783.523692:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147525888 00000100:00100000:2.0:1788651783.523696:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147525888 00000100:00100000:2.0:1788651783.523712:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788651783.523717:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147525888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.524041:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147525888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 322us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.524047:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788651783.524112:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147525888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.524580:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10348:1875537147526016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651783.524677:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651783.524743:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651783.524839:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147526016 00000100:00100000:3.0:1788651783.524844:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147526016 00000100:00100000:1.0:1788651783.524888:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788651783.524900:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:10348:x1875537147526016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651783.525026:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:10348:x1875537147526016:12345-0@lo:502:llog_process_th.0 Request processed in 129us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651783.525035:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788651783.525134:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10348:1875537147526016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651783.525173:0:10348:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10348:1875537147526144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651783.525401:0:10348:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651783.525464:0:10348:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651783.525496:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147526144 00000100:00100000:3.0:1788651783.525500:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147526144 00000100:00100000:3.0:1788651783.525675:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788651783.525684:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:10348:x1875537147526144:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651783.525769:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:10348:x1875537147526144:12345-0@lo:502:llog_process_th.0 Request processed in 87us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651783.525776:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1788651783.525840:0:10348:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10348:1875537147526144:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788651783.525862:0:10348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788651783.526330:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788651783.526350:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788651783.526360:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.526369:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651783.526379:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788651783.526381:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788651783.526384:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788651783.526409:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.526417:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.526426:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651783.526440:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147526272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651783.526472:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651783.526530:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147526272 00000100:00100000:0.0:1788651783.526535:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147526272 00000100:00100000:1.0:1788651783.526539:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.526598:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788651783.526607:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147526272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651783.526685:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651783.526697:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4000/0xcd2f56ea038c3c94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3c8d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.526717:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4000/0xcd2f56ea038c3c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c8d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.526728:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da4000/0xcd2f56ea038c3c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c8d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.526737:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4000, rc 0) 00000100:00100000:1.0:1788651783.526902:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147526272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651783.526934:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.526943:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651783.526994:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147526400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651783.527016:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.527030:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.527079:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147526272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 473us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.527085:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788651783.527109:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147526400 00000100:00100000:0.0:1788651783.527113:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147526400 00000100:00100000:0.0:1788651783.527141:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788651783.527148:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147526400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.527518:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147526400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.527525:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788651783.527571:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147526400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651783.527597:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147526528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651783.527698:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.527723:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.527790:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147526528 00000100:00100000:2.0:1788651783.527796:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147526528 00000100:00100000:2.0:1788651783.527829:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788651783.527836:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147526528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.527942:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147526528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.527949:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788651783.528152:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147526528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651783.529923:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10349:1875537147526656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651783.530013:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.530052:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651783.530189:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147526656 00000100:00100000:0.0:1788651783.530196:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147526656 00000100:00100000:0.0:1788651783.530250:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788651783.530259:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:10349:x1875537147526656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651783.530396:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:10349:x1875537147526656:12345-0@lo:502:llog_process_th.0 Request processed in 137us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651783.530413:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1788651783.530713:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10349:1875537147526656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788651783.530744:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651783.530753:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651783.530756:0:10349:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788651783.530762:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788651783.530783:0:10349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10349:1875537147526784:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651783.530819:0:10349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651783.530858:0:10349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c547bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.530938:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147526784 00000100:00100000:2.0:1788651783.530943:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147526784 00000100:00100000:2.0:1788651783.530973:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788651783.530980:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:10349:x1875537147526784:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651783.531515:0:10349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10349:1875537147526784:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788651783.531539:0:10349:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651783.531544:0:10349:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651783.531546:0:10349:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788651783.531550:0:10349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000100:00100000:2.0:1788651783.531761:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:10349:x1875537147526784:12345-0@lo:502:llog_process_th.0 Request processed in 96us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651783.531772:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:01000000:0.0:1788651783.533448:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1788651783.533490:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788651783.533505:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.533517:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651783.533528:0:6507:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788651783.533531:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f86da6c3380 from 1 10000000:01000000:0.0:1788651783.533534:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788651783.534232:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.534524:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651783.534537:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651783.534567:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147526912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788651783.539446:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651783.539503:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280180 going to sleep for 11 seconds 00000100:00100000:1.0:1788651783.539967:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147526912 00000100:00100000:1.0:1788651783.539977:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147526912 00000100:00100000:1.0:1788651783.540028:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788651783.540037:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147526912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651783.540054:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651783.540073:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff415600/0xcd2f56ea038c3ca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3c9b expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.540116:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff415600/0xcd2f56ea038c3ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c9b expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.540128:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff415600/0xcd2f56ea038c3ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3c9b expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651783.540137:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415600, rc 0) 00000100:00100000:1.0:1788651783.540195:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147526912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651783.540202:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788651783.540332:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147526912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651783.540348:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ca2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.540358:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3ca2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651783.540446:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147527040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651783.540475:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651783.540505:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788651783.540885:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147527040 00000100:00100000:2.0:1788651783.540897:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147527040 00000100:00100000:2.0:1788651783.540955:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788651783.540962:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147527040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651783.541058:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147527040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (582us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788651783.541064:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788651783.541481:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147527040:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1788651783.541510:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788651783.541519:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ca2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651783.541528:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ca2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651783.650705:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651784.160202:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147527168:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788651784.160297:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651784.160650:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147527168 00000100:00100000:3.0:1788651784.160659:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147527168 00000100:00100000:3.0:1788651784.160711:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788651784.160721:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147527168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788651784.160753:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788651784.160816:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147527168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 96us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651784.160823:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788651784.161022:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147527168:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788651784.672808:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651784.868028:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651784.868122:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125447168 00000100:00100000:2.0:1788651784.868133:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125447168 00000100:00100000:2.0:1788651784.868203:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 245 00000100:00100000:2.0:1788651784.868215:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:6166:x1875537125447168:12345-192.168.204.45@tcp:101: 00010000:00010000:2.0:1788651784.868232:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651784.868264:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3ca9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33b2a expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651784.868296:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b2a expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651784.868308:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b2a expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651784.868319:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dcc00, rc 0) 00000100:00100000:2.0:1788651784.868760:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6166:x1875537125447168:12345-192.168.204.45@tcp:101: Request processed in 546us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651784.868768:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 245 00000100:00100000:1.0:1788651784.889545:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651784.889776:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125447296 00000100:00100000:2.0:1788651784.889787:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125447296 00000100:00100000:2.0:1788651784.889854:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 246 00000100:00100000:2.0:1788651784.889872:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6166:x1875537125447296:12345-192.168.204.45@tcp:501: 00000100:00100000:2.0:1788651784.890066:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6166:x1875537125447296:12345-192.168.204.45@tcp:501: Request processed in 196us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651784.890075:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 246 00000100:00100000:0.0:1788651784.893538:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651784.893711:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125447424 00000100:00100000:2.0:1788651784.893722:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125447424 00000100:00100000:2.0:1788651784.893834:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 247 00000100:00100000:2.0:1788651784.893845:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6166:x1875537125447424:12345-192.168.204.45@tcp:503: 00000100:00100000:2.0:1788651784.894024:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6166:x1875537125447424:12345-192.168.204.45@tcp:503: Request processed in 180us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651784.894031:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 247 00000100:00100000:1.0:1788651784.905200:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651784.905393:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125447552 00000100:00100000:3.0:1788651784.905405:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125447552 00000100:00100000:3.0:1788651784.905473:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 248 00000100:00100000:3.0:1788651784.905483:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6659:x1875537125447552:12345-192.168.204.45@tcp:502: 00000100:00100000:3.0:1788651784.905666:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6659:x1875537125447552:12345-192.168.204.45@tcp:502: Request processed in 183us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651784.905681:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 248 00000100:00100000:3.0:1788651784.908244:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651784.908441:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125447680 00000100:00100000:2.0:1788651784.908451:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125447680 00000100:00100000:2.0:1788651784.908506:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 249 00000100:00100000:2.0:1788651784.908516:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6659:x1875537125447680:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788651784.908897:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6659:x1875537125447680:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 377us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651784.908933:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 249 00000100:00100000:0.0:1788651784.914304:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651784.914468:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125447808 00000100:00100000:1.0:1788651784.914478:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125447808 00000100:00100000:1.0:1788651784.914540:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 250 00000100:00100000:1.0:1788651784.914550:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6166:x1875537125447808:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651784.914566:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651784.914585:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3cb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33b31 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651784.914628:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b31 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651784.914641:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b31 expref: 10 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651784.914649:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415400, rc 0) 00000100:00100000:1.0:1788651784.914706:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6166:x1875537125447808:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 Request processed in 157us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651784.914713:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 250 00000100:00100000:1.0:1788651784.923295:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651784.923384:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125447936 00000100:00100000:3.0:1788651784.923396:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125447936 00000100:00100000:3.0:1788651784.923456:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 251 00000100:00100000:3.0:1788651784.923466:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6166:x1875537125447936:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651784.923831:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6166:x1875537125447936:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 Request processed in 366us (547us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788651784.923840:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 251 00000100:00100000:3.0:1788651785.697559:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651785.697583:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147527296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651785.697867:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651785.697999:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147527296 00000100:00100000:1.0:1788651785.698009:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147527296 00000100:00100000:1.0:1788651785.698077:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788651785.698088:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147527296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788651785.698129:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651785.698182:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147527296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 96us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651785.698189:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:2.0:1788651785.698928:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651785.699047:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147527424:0@lo:400:kworker.0 00000100:00100000:2.0:1788651785.699095:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651785.699141:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147527936:0@lo:400:kworker.0 00000100:00100000:2.0:1788651785.699168:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651785.699186:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147528448:0@lo:400:kworker.0 00000100:00100000:2.0:1788651785.699231:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651785.699253:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788651785.699258:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147527552:0@lo:400:kworker.0 00000100:00100000:2.0:1788651785.699280:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651785.699295:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147528064:0@lo:400:kworker.0 00000100:00100000:2.0:1788651785.699311:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651785.699324:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147528576:0@lo:400:kworker.0 00000100:00100000:2.0:1788651785.699357:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651785.699386:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147527552 00000100:00100000:2.0:1788651785.699392:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147527552 00000100:00100000:0.0:1788651785.699832:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147527936 00000100:00100000:0.0:1788651785.699837:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147527936 00000100:00100000:0.0:1788651785.699881:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788651785.699891:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147527936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.699984:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147527936:12345-0@lo:400:kworker.0 Request processed in 92us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651785.699992:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788651785.700014:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147528064 00000100:00100000:0.0:1788651785.700017:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147528064 00000100:00100000:0.0:1788651785.700035:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147528576 00000100:00100000:0.0:1788651785.700037:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147528576 00000100:00100000:0.0:1788651785.700050:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788651785.700057:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147527552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.700088:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147527552:12345-0@lo:400:kworker.0 Request processed in 32us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651785.700094:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788651785.700215:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788651785.700233:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147528064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.700263:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147528064:12345-0@lo:400:kworker.0 Request processed in 32us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651785.700269:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788651785.700280:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788651785.700285:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147528576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.700309:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147528576:12345-0@lo:400:kworker.0 Request processed in 24us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651785.700315:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788651785.701873:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651785.701882:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651785.701894:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651785.701942:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147528960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651785.702011:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651785.702058:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147528448 00000100:00100000:3.0:1788651785.702065:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147528448 00000100:00100000:3.0:1788651785.702124:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788651785.702133:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147528448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651785.702181:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147528448:12345-0@lo:400:kworker.0 Request processed in 49us (2948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651785.702187:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1788651785.702215:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651785.702245:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147527680:0@lo:400:kworker.0 00000100:00100000:3.0:1788651785.702286:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651785.702308:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147528192:0@lo:400:kworker.0 00000100:00100000:3.0:1788651785.702342:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651785.702362:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147528704:0@lo:400:kworker.0 00000100:00100000:3.0:1788651785.702384:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788651785.702418:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeaee300 x1875537147527296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651785.702452:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147527296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651785.702473:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788651785.702479:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147527808:0@lo:400:kworker.0 00000100:00100000:3.0:1788651785.702502:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651785.702518:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147528320:0@lo:400:kworker.0 00000100:00100000:3.0:1788651785.702539:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651785.702557:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147528832:0@lo:400:kworker.0 00000100:00100000:3.0:1788651785.702574:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651785.702597:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147528320 00000100:00100000:3.0:1788651785.702601:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147528320 00000100:00100000:3.0:1788651785.702625:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147528832 00000100:00100000:3.0:1788651785.702628:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147528832 00000100:00100000:3.0:1788651785.702646:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788651785.702652:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147528320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651785.702704:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147528320:12345-0@lo:400:kworker.0 Request processed in 51us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651785.702710:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788651785.702722:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788651785.702738:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147528832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651785.702768:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147528832:12345-0@lo:400:kworker.0 Request processed in 32us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651785.702773:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788651785.702851:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147528960 00000100:00100000:1.0:1788651785.702856:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147528960 00000100:00100000:1.0:1788651785.702882:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788651785.702889:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147528960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651785.702903:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651785.702986:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147528960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651785.702993:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788651785.703029:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c310b480 x1875537147528960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651801 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651785.706594:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147527552:0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.706632:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147528064:0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.706666:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147528576:0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.706692:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147527936:0@lo:400:kworker.0 00010000:00080000:0.0:1788651785.706709:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3459500 x1875537147528448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651785.706720:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147528448:0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.706781:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147527680 00000100:00100000:0.0:1788651785.706788:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147527680 00000100:00100000:0.0:1788651785.706868:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788651785.706885:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147527680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.707010:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147527680:12345-0@lo:400:kworker.0 Request processed in 134us (4723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651785.707017:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788651785.707163:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147528192 00000100:00100000:0.0:1788651785.707169:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147528192 00000100:00100000:0.0:1788651785.707203:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147528704 00000100:00100000:0.0:1788651785.707207:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147528704 00000100:00100000:0.0:1788651785.707239:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147527808 00000100:00100000:0.0:1788651785.707242:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147527808 00000100:00100000:0.0:1788651785.707256:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788651785.707263:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147528192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.707303:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147528192:12345-0@lo:400:kworker.0 Request processed in 41us (4960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651785.707309:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788651785.707320:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788651785.707338:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147528704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.707388:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147528704:12345-0@lo:400:kworker.0 Request processed in 62us (5003us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651785.707394:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788651785.707406:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788651785.707413:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147527808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.707456:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147527808:12345-0@lo:400:kworker.0 Request processed in 44us (4952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651785.707462:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788651785.707481:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651785.707486:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651785.707488:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651785.707518:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147527424 00000100:00100000:0.0:1788651785.707522:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147527424 00000100:00100000:0.0:1788651785.707552:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788651785.707559:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147527424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.707594:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147527424:12345-0@lo:400:kworker.0 Request processed in 35us (8498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651785.707599:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788651785.707638:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147527424:0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.707721:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147527808:0@lo:400:kworker.0 00010000:00080000:0.0:1788651785.707735:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c345a300 x1875537147528320/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651785.707746:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147528320:0@lo:400:kworker.0 00010000:00080000:0.0:1788651785.707759:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c345b480 x1875537147528832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651785.707779:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147528832:0@lo:400:kworker.0 00000100:00100000:0.0:1788651785.707794:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147527680:0@lo:400:kworker.0 00010000:00080000:0.0:1788651785.707803:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3459180 x1875537147528192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651785.707810:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147528192:0@lo:400:kworker.0 00010000:00080000:0.0:1788651785.707819:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c345aa00 x1875537147528704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651801 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651785.707827:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147528704:0@lo:400:kworker.0 00000100:00100000:1.0:1788651785.710867:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147528960:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788651786.726290:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651786.729561:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147529216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651786.729637:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651786.730790:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651786.730812:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147529088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651786.730863:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651786.730955:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147529216 00000100:00100000:3.0:1788651786.730964:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147529216 00000100:00100000:3.0:1788651786.731003:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147529088 00000100:00100000:3.0:1788651786.731006:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147529088 00000100:00100000:3.0:1788651786.731020:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788651786.731028:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147529216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788651786.731063:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651786.731416:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147529216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 387us (1778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651786.731424:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788651786.731442:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788651786.731448:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147529088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651786.731478:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651786.731511:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147529088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (648us total) trans 0 rc 0/0 00010000:00080000:2.0:1788651786.731664:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c348ce00 x1875537147529216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651786.731685:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147529216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651786.731784:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788651786.731813:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d109a300 x1875537147529088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651786.731827:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147529088:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788651786.912722:0:10387:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb20af920 20000000:00000080:0.0:1788651786.912740:0:10387:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f86fce0fc00 uarg=0000000000000000 20000000:01000000:0.0:1788651786.912781:0:10387:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788651786.912787:0:10387:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788651786.912792:0:10387:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788651786.916418:0:10388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788651786.916662:0:10387:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788651786.932212:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788651786.932262:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788651786.932281:0:10387:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788651786.932297:0:10387:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788651786.932318:0:10387:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932337:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3953 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c394c expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932344:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3961 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c395a expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932366:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c29dda00/0xcd2f56ea038c39b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c39ae expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932373:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3adb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ad4 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932383:0:10387:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3bf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33af2 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932392:0:10387:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932435:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33af2 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932451:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3bf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33af2 expref: 9 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651786.932468:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3108000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875537147529344:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651786.932606:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3adb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3ad4 expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932615:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3adb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ad4 expref: 23 pid: 6502 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651786.932625:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875537147529472:0@lo:104: 00000100:00100000:0.0:1788651786.932669:0:10387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651786.932699:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c29dda00/0xcd2f56ea038c39b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c39ae expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932714:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86c29dda00/0xcd2f56ea038c39b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c39ae expref: 23 pid: 6502 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651786.932723:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875537147529600:0@lo:104: 00000100:00100000:0.0:1788651786.932746:0:10387:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651786.932765:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c395a expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932772:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c395a expref: 23 pid: 6505 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651786.932779:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875537147529728:0@lo:104: 00010000:00010000:0.0:1788651786.932799:0:10387:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c394c expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.932806:0:10387:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c394c expref: 23 pid: 6504 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651786.932814:0:10387:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875537147529856:0@lo:104: 00000100:00100000:0.0:1788651786.932832:0:10387:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ee8e0840 going to sleep for 11 seconds 00000100:00100000:0.0:1788651786.935551:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3108000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875537147529344:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651786.936229:0:6494:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788651786.936261:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651786.936298:0:6494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651786.936308:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147529472 00000100:00100000:2.0:1788651786.936315:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147529472 00000100:00100000:2.0:1788651786.936351:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147529600 00000100:00100000:2.0:1788651786.936354:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147529600 00000100:00100000:2.0:1788651786.936365:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147529728 00000100:00100000:2.0:1788651786.936367:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147529728 00000100:00100000:2.0:1788651786.936375:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147529856 00000100:00100000:2.0:1788651786.936376:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147529856 00000100:00100000:2.0:1788651786.936388:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788651786.936406:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:10387:x1875537147529472:12345-0@lo:104: 00010000:00010000:2.0:1788651786.936423:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651786.936487:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788651786.936493:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:10387:x1875537147529472:12345-0@lo:104: Request processed in 90us (3825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651786.936500:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:3.0:1788651786.936713:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651786.936720:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651786.936729:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dde00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651786.936733:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651786.936743:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651786.936751:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651786.936756:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788651786.936795:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651786.936802:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651786.936822:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651786.936830:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c23dde00/0xcd2f56ea038c3ad4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3adb expref: -99 pid: 9504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651786.936844:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651786.936846:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651786.936848:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651786.936873:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147529984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651786.936952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651786.937003:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147529984 00000100:00100000:3.0:1788651786.937008:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147529984 00010000:00010000:3.0:1788651786.937028:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3adb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ad4 expref: 24 pid: 6502 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651786.937048:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788651786.937054:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147529984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651786.937065:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651786.937070:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3adb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ad4 expref: 24 pid: 6502 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651786.937079:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3adb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ad4 expref: 24 pid: 6502 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651786.937095:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651786.937122:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147529984:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651786.937128:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788651786.937161:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147529984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651786.937303:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788651786.937313:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eebfd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:10387:x1875537147529600:12345-0@lo:104: 00010000:00010000:0.0:1788651786.937322:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937367:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788651786.937378:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eebfd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+6:10387:x1875537147529600:12345-0@lo:104: Request processed in 68us (4631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651786.937384:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788651786.937397:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788651786.937403:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:10387:x1875537147529728:12345-0@lo:104: 00010000:00010000:0.0:1788651786.937410:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937443:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788651786.937447:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:10387:x1875537147529728:12345-0@lo:104: Request processed in 45us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651786.937453:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788651786.937464:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788651786.937469:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:10387:x1875537147529856:12345-0@lo:104: 00010000:00010000:0.0:1788651786.937476:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937501:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788651786.937530:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:10387:x1875537147529856:12345-0@lo:104: Request processed in 61us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651786.937536:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:0.0:1788651786.937553:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788651786.937557:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937563:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dce00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651786.937567:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937709:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651786.937716:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651786.937721:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788651786.937743:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937749:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651786.937761:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937768:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c39ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c39b5 expref: -99 pid: 8420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937781:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788651786.937785:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937789:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dc200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651786.937792:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937799:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651786.937804:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651786.937815:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788651786.937829:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937835:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651786.937840:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937846:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c29dc200/0xcd2f56ea038c395a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3961 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937855:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651786.937858:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937863:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651786.937866:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c394c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937872:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c394c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651786.937878:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c394c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651786.937883:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788651786.937894:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c394c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937899:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651786.937942:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c394c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937948:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c394c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3953 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.937960:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651786.937962:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651786.937964:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651786.938342:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3adb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3ad4 expref: 23 pid: 6502 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651786.938354:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875537147529472:0@lo:104: 00000100:00100000:1.0:1788651786.938364:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875537147529600:0@lo:104: 00000100:00100000:1.0:1788651786.938372:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875537147529728:0@lo:104: 00000100:00100000:1.0:1788651786.938380:0:10387:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10387:1875537147529856:0@lo:104: 00010000:00010000:1.0:1788651786.938410:0:10387:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651786.938902:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651786.938942:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147530112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651786.938988:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651786.939025:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651786.939031:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147530240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651786.939050:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651786.939076:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147530368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651786.939100:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651786.939134:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651786.939221:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147530112 00000100:00100000:2.0:1788651786.939227:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147530112 00010000:00010000:2.0:1788651786.939253:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c29dda00/0xcd2f56ea038c39b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c39ae expref: 23 pid: 6502 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651786.939284:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147530240 00000100:00100000:2.0:1788651786.939287:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147530240 00010000:00010000:2.0:1788651786.939299:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c395a expref: 24 pid: 6505 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651786.939307:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147530368 00000100:00100000:2.0:1788651786.939310:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147530368 00010000:00010000:2.0:1788651786.939317:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c394c expref: 25 pid: 6504 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651786.939328:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788651786.939335:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+25:3637:x1875537147530112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788651786.939346:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651786.939350:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c29dda00/0xcd2f56ea038c39b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c39ae expref: 25 pid: 6502 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651786.939359:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c29dda00/0xcd2f56ea038c39b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c39ae expref: 25 pid: 6502 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651786.939379:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c29dda00/0xcd2f56ea038c39b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c39ae expref: 25 pid: 6502 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651786.939393:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651786.939427:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3661180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147530112:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651786.939434:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788651786.939448:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788651786.939453:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:3637:x1875537147530240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788651786.939462:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651786.939466:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3961 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c395a expref: 23 pid: 6505 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651786.939473:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3961 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c395a expref: 23 pid: 6505 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651786.939482:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3961 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c395a expref: 23 pid: 6505 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651786.939491:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651786.939768:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788651786.939778:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3635:x1875537147530368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651786.939787:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651786.939792:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3953 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c394c expref: 22 pid: 6504 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.939808:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c394c expref: 22 pid: 6504 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.939819:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3953 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c394c expref: 22 pid: 6504 timeout: 392 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.939828:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651786.939855:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3635:x1875537147530368:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651786.939861:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788651786.939990:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3637:x1875537147530240:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651786.939999:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788651786.940318:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147530368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651786.940347:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147530240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651786.940354:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147530112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651786.947179:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651786.947261:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125448064 00000100:00100000:1.0:1788651786.947270:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125448064 00010000:00010000:1.0:1788651786.947308:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3bf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33af2 expref: 10 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651786.947349:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 39 00000100:00100000:1.0:1788651786.947358:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2389:x1875537125448064:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651786.947374:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651786.947381:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3bf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33af2 expref: 10 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947394:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3bf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33af2 expref: 10 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947411:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3bf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33af2 expref: 10 pid: 6505 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947427:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947450:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947466:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947474:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947481:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947489:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947495:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651786.947499:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947508:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947531:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651786.947542:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651786.947610:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:2389:x1875537125448064:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 252us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651786.947618:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 39 00010000:00010000:0.0:1788651786.947971:0:10387:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.947981:0:10387:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651786.947987:0:10387:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3cb7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651787.427057:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651787.427168:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651787.427212:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651787.427261:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125448576 00000100:00100000:3.0:1788651787.427271:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125448576 00000100:00100000:3.0:1788651787.427339:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:3.0:1788651787.427348:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125448576:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651787.427418:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125448576:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651787.427428:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:1.0:1788651787.427729:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651787.427764:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125448448 00000100:00100000:1.0:1788651787.427768:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125448448 00000100:00100000:1.0:1788651787.428116:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:1.0:1788651787.428125:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125448448:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651787.428177:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125448448:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 53us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651787.428194:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00080000:1.0:1788651787.428227:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651787.428231:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651787.428723:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125448320 00000100:00100000:0.0:1788651787.428730:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125448320 00000100:00100000:3.0:1788651787.430681:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125448192 00000100:00100000:3.0:1788651787.430692:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125448192 00000100:00100000:3.0:1788651787.430780:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 74 00000100:00100000:3.0:1788651787.430996:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125448192:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651787.431072:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125448192:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 81us (3860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651787.431080:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 74 00000100:00080000:3.0:1788651787.431103:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651787.431511:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 75 00000100:00100000:1.0:1788651787.431519:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125448320:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651787.431560:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125448320:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 42us (4514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651787.431566:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 75 00000100:00080000:3.0:1788651787.435265:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651787.744021:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147530496:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651787.744100:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651787.744170:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147530496 00000100:00100000:3.0:1788651787.744189:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147530496 00000100:00100000:3.0:1788651787.744249:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788651787.744258:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147530496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651787.744300:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651787.744358:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147530496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651787.744366:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788651787.744444:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147530496:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788651787.750589:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651788.769213:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788651788.832013:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788651788.832022:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f85c196d800 from 4 10000000:01000000:3.0:1788651788.832027:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788651788.832655:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651788.832667:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651788.832678:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651788.832705:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147530624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788651788.832776:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651788.832885:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.833611:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147530624 00000100:00100000:1.0:1788651788.833622:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147530624 00000100:00100000:1.0:1788651788.833669:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788651788.833682:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147530624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651788.833695:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651788.833711:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3cc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3cbe expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.833736:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3cc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3cbe expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.833892:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3cc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3cbe expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.833900:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414000, rc 0) 00000100:00100000:1.0:1788651788.833975:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147530624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 297us (1198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.833982:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788651788.834014:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147530624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651788.834029:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651788.834038:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651788.834119:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147530752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651788.834175:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651788.834219:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651788.834297:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147530752 00000100:00100000:0.0:1788651788.834303:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147530752 00000100:00100000:0.0:1788651788.834340:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788651788.834347:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147530752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651788.834589:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147530752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651788.834598:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788651788.835240:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147530752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651788.835277:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147530880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651788.835324:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651788.835350:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.835377:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147530880 00000100:00100000:1.0:1788651788.835383:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147530880 00000100:00100000:1.0:1788651788.835413:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788651788.835420:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147530880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.835537:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147530880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 117us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.835545:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788651788.836490:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147530880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651788.837381:0:10466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10466:1875537147531008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651788.837447:0:10466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651788.837558:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147531008 00000100:00100000:2.0:1788651788.837564:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147531008 00000100:00100000:2.0:1788651788.837613:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788651788.837621:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:10466:x1875537147531008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651788.837721:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:10466:x1875537147531008:12345-0@lo:502:llog_process_th.0 Request processed in 101us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651788.837728:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788651788.837796:0:10466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651788.837811:0:10466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10466:1875537147531008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651788.837833:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651788.837842:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651788.837844:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788651788.837852:0:10466:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f85c196d800 00000020:00000080:3.0:1788651788.837854:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788651788.837950:0:10466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10466:1875537147531136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651788.837980:0:10466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651788.838004:0:10466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651788.838115:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147531136 00000100:00100000:0.0:1788651788.838124:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147531136 00000100:00100000:0.0:1788651788.838155:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788651788.838173:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:10466:x1875537147531136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651788.838252:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:10466:x1875537147531136:12345-0@lo:502:llog_process_th.0 Request processed in 79us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651788.838259:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788651788.840127:0:10466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10466:1875537147531136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788651788.840175:0:10466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651788.840183:0:10466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651788.840185:0:10466:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788651788.840191:0:10466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788651788.840707:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788651788.840730:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788651788.840742:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651788.840754:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651788.840764:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788651788.840767:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86eeab9800 from 4 10000000:01000000:0.0:1788651788.840770:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788651788.840805:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651788.840814:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651788.840824:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651788.840844:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147531264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788651788.840898:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651788.840994:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc1da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651788.841294:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147531264 00000100:00100000:2.0:1788651788.841302:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147531264 00000100:00100000:2.0:1788651788.841356:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788651788.841464:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147531264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651788.841541:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651788.841557:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c3cd3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3ccc expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651788.841581:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c3cd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ccc expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651788.841592:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c3cd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ccc expref: 22 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651788.841599:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc600, rc 0) 00000100:00100000:2.0:1788651788.842822:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147531264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1452us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651788.842831:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788651788.849259:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147531264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651788.849292:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651788.849306:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651788.849592:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147531392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651788.849665:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651788.850349:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.859487:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147531392 00000100:00100000:1.0:1788651788.859504:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147531392 00000100:00100000:1.0:1788651788.859563:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788651788.859573:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147531392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.859742:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147531392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 170us (10076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.859751:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788651788.859798:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3660380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147531392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.859867:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147531520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.859929:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651788.859980:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ee0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.859995:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147531520 00000100:00100000:1.0:1788651788.859998:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147531520 00000100:00100000:1.0:1788651788.860017:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788651788.860024:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147531520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.862225:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147531520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2193us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.862239:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788651788.862314:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147531520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651788.863944:0:10470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3661f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10470:1875537147531648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651788.864025:0:10470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651788.864074:0:10470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.864457:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147531648 00000100:00100000:1.0:1788651788.864465:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147531648 00000100:00100000:1.0:1788651788.864513:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788651788.864521:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:10470:x1875537147531648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651788.864630:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:10470:x1875537147531648:12345-0@lo:502:llog_process_th.0 Request processed in 110us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.864637:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788651788.864792:0:10470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3661f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10470:1875537147531648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651788.864824:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651788.864833:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651788.864836:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788651788.864843:0:10470:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86eeab9800 00000020:00000080:3.0:1788651788.864846:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788651788.864950:0:10470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3661f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10470:1875537147531776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651788.865567:0:10470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651788.865600:0:10470:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fce2bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651788.866293:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147531776 00000100:00100000:2.0:1788651788.866299:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147531776 00000100:00100000:2.0:1788651788.866338:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788651788.866345:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:10470:x1875537147531776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651788.866462:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:10470:x1875537147531776:12345-0@lo:502:llog_process_th.0 Request processed in 117us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651788.866469:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788651788.866896:0:10470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3661f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10470:1875537147531776:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651788.866951:0:10470:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651788.866958:0:10470:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651788.866959:0:10470:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788651788.866976:0:10470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788651788.867447:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788651788.868680:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788651788.868695:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.868707:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651788.868718:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788651788.868720:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86f48d9800 from 4 10000000:01000000:1.0:1788651788.868723:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788651788.868756:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.868771:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.868781:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651788.868804:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147531904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.868857:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651788.868892:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.868926:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147531904 00000100:00100000:1.0:1788651788.868932:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147531904 00000100:00100000:1.0:1788651788.869557:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788651788.869567:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147531904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651788.869580:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651788.869592:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ce1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3cda expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.869614:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ce1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3cda expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.869624:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ce1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3cda expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.869632:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415000, rc 0) 00000100:00100000:1.0:1788651788.872690:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147531904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3113us (3820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.872704:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788651788.878274:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147531904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651788.878305:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651788.878319:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651788.879770:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147532032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651788.879838:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651788.879876:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c64373c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.880579:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147532032 00000100:00100000:1.0:1788651788.880588:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147532032 00000100:00100000:1.0:1788651788.880640:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788651788.880649:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147532032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.880780:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147532032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 132us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.880788:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788651788.881202:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147532032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651788.881243:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147532160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651788.881290:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651788.881313:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c64373c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.882525:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147532160 00000100:00100000:1.0:1788651788.882535:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147532160 00000100:00100000:1.0:1788651788.882574:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788651788.882582:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147532160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.882691:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147532160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (1399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.882698:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788651788.882847:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147532160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651788.892731:0:10472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10472:1875537147532288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651788.892818:0:10472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651788.892867:0:10472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6437e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.893469:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147532288 00000100:00100000:1.0:1788651788.893542:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147532288 00000100:00100000:1.0:1788651788.893590:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788651788.893599:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:10472:x1875537147532288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651788.893733:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:10472:x1875537147532288:12345-0@lo:502:llog_process_th.0 Request processed in 135us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.893740:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788651788.894893:0:10472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10472:1875537147532288:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651788.894956:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651788.894977:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651788.894979:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788651788.894988:0:10472:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86f48d9800 00000020:00000080:0.0:1788651788.894991:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788651788.895077:0:10472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10472:1875537147532416:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651788.895280:0:10472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651788.895316:0:10472:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc1d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.895889:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147532416 00000100:00100000:1.0:1788651788.895896:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147532416 00000100:00100000:1.0:1788651788.895979:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788651788.895988:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:10472:x1875537147532416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651788.896092:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:10472:x1875537147532416:12345-0@lo:502:llog_process_th.0 Request processed in 106us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.896116:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788651788.900173:0:10472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10472:1875537147532416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651788.900228:0:10472:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651788.900238:0:10472:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651788.900240:0:10472:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788651788.900244:0:10472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788651788.900984:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788651788.901006:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788651788.901016:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651788.901028:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651788.901040:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788651788.901043:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86da667000 from 4 10000000:01000000:0.0:1788651788.901046:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788651788.901079:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651788.901087:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651788.901119:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651788.901140:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147532544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788651788.901208:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651788.901246:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc1d180 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.901540:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147532544 00000100:00100000:1.0:1788651788.901547:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147532544 00000100:00100000:1.0:1788651788.901598:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788651788.901607:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147532544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651788.901619:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651788.901631:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c3cef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3ce8 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.901653:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c3cef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ce8 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.901662:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c3cef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ce8 expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.901670:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415800, rc 0) 00000100:00100000:1.0:1788651788.901709:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147532544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.901716:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788651788.901753:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147532544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651788.901766:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651788.901775:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651788.901829:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147532672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.901861:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651788.901875:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12780 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.901888:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147532672 00000100:00100000:1.0:1788651788.901892:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147532672 00000100:00100000:1.0:1788651788.901933:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788651788.901939:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147532672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.902051:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147532672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.902058:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788651788.902087:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147532672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.902447:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147532800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651788.902561:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651788.902620:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0c12780 going to sleep for 11 seconds 00000100:00100000:0.0:1788651788.914996:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147532800 00000100:00100000:0.0:1788651788.915012:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147532800 00000100:00100000:0.0:1788651788.915238:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788651788.915250:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147532800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651788.915547:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147532800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 299us (12984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651788.915556:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788651788.916125:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147532800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651788.930346:0:10477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10477:1875537147532928:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651788.931582:0:10477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651788.931636:0:10477:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651788.931686:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147532928 00000100:00100000:0.0:1788651788.931694:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147532928 00000100:00100000:0.0:1788651788.931745:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788651788.931754:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:10477:x1875537147532928:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651788.931874:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:10477:x1875537147532928:12345-0@lo:502:llog_process_th.0 Request processed in 121us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651788.931883:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788651788.932600:0:10477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10477:1875537147532928:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788651788.932638:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651788.932649:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651788.932652:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788651788.932661:0:10477:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86da667000 00000020:00000080:2.0:1788651788.932664:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788651788.932754:0:10477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10477:1875537147533056:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651788.932802:0:10477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651788.932834:0:10477:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8180 going to sleep for 11 seconds 00000100:00100000:1.0:1788651788.934063:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147533056 00000100:00100000:1.0:1788651788.934074:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147533056 00000100:00100000:1.0:1788651788.934227:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788651788.934237:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:10477:x1875537147533056:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651788.934380:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:10477:x1875537147533056:12345-0@lo:502:llog_process_th.0 Request processed in 146us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651788.934388:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788651788.934484:0:10477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:10477:1875537147533056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651788.934514:0:10477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651788.934520:0:10477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651788.934522:0:10477:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788651788.934527:0:10477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788651788.939549:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788651788.939585:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788651788.939597:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651788.939609:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651788.966797:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651788.966873:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125448704 00000100:00100000:0.0:1788651788.966883:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125448704 00000100:00100000:3.0:1788651788.967467:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 273 00000100:00100000:3.0:1788651788.967480:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:6166:x1875537125448704:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651788.967509:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651788.967531:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3cf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33b38 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651788.967561:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3cf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b38 expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651788.967574:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3cf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b38 expref: 10 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651788.967583:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dc400, rc 0) 00000100:00100000:3.0:1788651788.967635:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6166:x1875537125448704:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 Request processed in 159us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651788.967642:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 273 00000100:00100000:3.0:1788651788.972846:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651788.972942:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125448832 00000100:00100000:0.0:1788651788.972953:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125448832 00000100:00100000:0.0:1788651788.973004:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 274 00000100:00100000:0.0:1788651788.973014:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6166:x1875537125448832:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651788.973179:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6166:x1875537125448832:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 Request processed in 165us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651788.973187:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 274 00000100:00100000:0.0:1788651788.979445:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651788.979658:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125448960 00000100:00100000:2.0:1788651788.979669:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125448960 00000100:00100000:2.0:1788651788.979718:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 275 00000100:00100000:2.0:1788651788.979728:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6166:x1875537125448960:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651788.979866:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6166:x1875537125448960:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 Request processed in 139us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651788.979873:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 275 00000100:00100000:3.0:1788651788.991478:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651788.991591:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125449088 00000100:00100000:0.0:1788651788.991600:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125449088 00000100:00100000:0.0:1788651788.991653:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 276 00000100:00100000:0.0:1788651788.991662:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6722:x1875537125449088:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788651788.991795:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6722:x1875537125449088:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 134us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651788.991804:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 276 00000100:00100000:0.0:1788651789.006823:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651789.006900:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125449216 00000100:00100000:2.0:1788651789.006947:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125449216 00000100:00100000:2.0:1788651789.007008:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 277 00000100:00100000:2.0:1788651789.007017:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6722:x1875537125449216:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788651789.007187:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:6722:x1875537125449216:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 170us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651789.007205:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 277 00000100:00100000:3.0:1788651789.280132:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147533184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651789.280222:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651789.282928:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147533184 00000100:00100000:1.0:1788651789.282943:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147533184 00000100:00100000:1.0:1788651789.282998:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788651789.283007:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147533184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651789.283049:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788651789.283123:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147533184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (2901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651789.283130:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788651789.283655:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147533184:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788651789.793945:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651790.818456:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651790.818540:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651790.818560:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147533312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651790.818639:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651790.818716:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147533312 00000100:00100000:3.0:1788651790.818724:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147533312 00000100:00100000:3.0:1788651790.818774:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788651790.818791:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147533312:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788651790.818822:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651790.818859:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147533312:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651790.818865:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788651790.818884:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788651790.818923:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3661880 x1875537147533312/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651790.818943:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147533312:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651790.825685:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147533440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651790.825925:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651790.825998:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147533440 00000100:00100000:3.0:1788651790.826019:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147533440 00000100:00100000:3.0:1788651790.826081:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788651790.826090:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147533440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651790.826116:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651790.826177:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147533440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651790.826185:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788651790.826212:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788651790.826238:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3661880 x1875537147533440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651806 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651790.826257:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147533440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651790.826889:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147533824:0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.826946:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651790.826969:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147534336:0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.826989:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651790.827007:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147534848:0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.827027:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651790.827048:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788651790.827054:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147533696:0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.827072:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651790.827087:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147534208:0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.827103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651790.827116:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147534720:0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.827145:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651790.827166:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147533824 00000100:00100000:1.0:1788651790.827172:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147533824 00000100:00100000:1.0:1788651790.827203:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788651790.827209:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147533824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.827249:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147533824:12345-0@lo:400:kworker.0 Request processed in 39us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651790.827255:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788651790.827273:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147534336 00000100:00100000:1.0:1788651790.827287:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147534336 00000100:00100000:1.0:1788651790.827312:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147534848 00000100:00100000:1.0:1788651790.827314:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147534848 00000100:00100000:2.0:1788651790.828260:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147533568:0@lo:400:kworker.0 00000100:00100000:2.0:1788651790.828310:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651790.828511:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147534080:0@lo:400:kworker.0 00000100:00100000:2.0:1788651790.828537:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651790.828557:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147534592:0@lo:400:kworker.0 00000100:00100000:2.0:1788651790.828579:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651790.828599:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788651790.828605:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147533952:0@lo:400:kworker.0 00000100:00100000:3.0:1788651790.828977:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147534080 00000100:00100000:3.0:1788651790.828985:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147534080 00000100:00100000:3.0:1788651790.829038:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788651790.829045:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147534080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651790.829094:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147534080:12345-0@lo:400:kworker.0 Request processed in 50us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651790.829101:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788651790.829216:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147534592 00000100:00100000:3.0:1788651790.829220:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147534592 00000100:00100000:3.0:1788651790.829251:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788651790.829258:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147534592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651790.829289:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147534592:12345-0@lo:400:kworker.0 Request processed in 32us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651790.829294:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788651790.829581:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651790.829603:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147534464:0@lo:400:kworker.0 00000100:00100000:2.0:1788651790.829638:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651790.829672:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147534080:0@lo:400:kworker.0 00010000:00080000:2.0:1788651790.829685:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36f6d80 x1875537147534592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651790.829694:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147534592:0@lo:400:kworker.0 00000100:00100000:2.0:1788651790.829734:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147534464 00000100:00100000:2.0:1788651790.829737:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147534464 00000100:00100000:2.0:1788651790.829763:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788651790.829769:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147534464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651790.829800:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147534464:12345-0@lo:400:kworker.0 Request processed in 31us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651790.829806:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788651790.829840:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36f4e00 x1875537147534464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651790.829849:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147534464:0@lo:400:kworker.0 00000100:00100000:3.0:1788651790.829992:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147533696 00000100:00100000:3.0:1788651790.829997:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147533696 00000100:00100000:3.0:1788651790.830015:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147534208 00000100:00100000:3.0:1788651790.830018:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147534208 00000100:00100000:3.0:1788651790.830030:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147534720 00000100:00100000:3.0:1788651790.830032:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147534720 00000100:00100000:3.0:1788651790.830045:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147533952 00000100:00100000:3.0:1788651790.830048:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147533952 00000100:00100000:3.0:1788651790.830061:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788651790.830068:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147534336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651790.830101:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147534336:12345-0@lo:400:kworker.0 Request processed in 34us (3111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651790.830107:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788651790.830118:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788651790.830136:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147534848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651790.830161:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147534848:12345-0@lo:400:kworker.0 Request processed in 26us (3134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651790.830172:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788651790.830184:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788651790.830188:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147533696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651790.830214:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147533696:12345-0@lo:400:kworker.0 Request processed in 26us (3141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651790.830219:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788651790.830228:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788651790.830234:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147534208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651790.830260:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147534208:12345-0@lo:400:kworker.0 Request processed in 27us (3156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651790.830266:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788651790.830276:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788651790.830283:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147534720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651790.830310:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147534720:12345-0@lo:400:kworker.0 Request processed in 28us (3164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651790.830315:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788651790.830337:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788651790.830344:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147533952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651790.830375:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147533952:12345-0@lo:400:kworker.0 Request processed in 32us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651790.830380:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788651790.830471:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147533952:0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.834062:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147533568 00000100:00100000:1.0:1788651790.834079:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147533568 00000100:00100000:1.0:1788651790.834148:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788651790.834156:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147533568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.834244:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147533568:12345-0@lo:400:kworker.0 Request processed in 88us (5932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651790.834251:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:1.0:1788651790.834316:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147533696:0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.834332:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147534208:0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.834344:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147534720:0@lo:400:kworker.0 00000100:00100000:1.0:1788651790.834357:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147533824:0@lo:400:kworker.0 00010000:00080000:1.0:1788651790.834370:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36f6a00 x1875537147534336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651790.834381:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147534336:0@lo:400:kworker.0 00010000:00080000:1.0:1788651790.834393:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36f7800 x1875537147534848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651806 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651790.834402:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147534848:0@lo:400:kworker.0 00000100:00080000:1.0:1788651790.834441:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651790.834448:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651790.834450:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788651790.847286:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147533568:0@lo:400:kworker.0 00010000:00010000:3.0:1788651791.840026:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651791.840330:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147534976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651791.840403:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651791.840590:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147534976 00000100:00100000:1.0:1788651791.840600:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147534976 00000100:00100000:1.0:1788651791.840659:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788651791.840669:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147534976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651791.840707:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651791.840757:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3661880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147534976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651791.840763:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788651791.841002:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36f7800 x1875537147534976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651791.841023:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147534976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651791.844689:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147535104:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651791.844773:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651791.845080:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147535104 00000100:00100000:1.0:1788651791.845088:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147535104 00000100:00100000:1.0:1788651791.845189:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788651791.845199:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147535104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651791.845224:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651791.847582:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147535104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2376us (2800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651791.847594:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788651791.847965:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3109c00 x1875537147535104/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651791.847991:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147535104:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788651792.549493:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651792.549534:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651792.549563:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651792.549584:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651792.549607:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651792.549635:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125449728 00000100:00100000:0.0:1788651792.549645:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125449728 00000100:00100000:0.0:1788651792.549723:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125449856 00000100:00100000:0.0:1788651792.549727:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125449856 00000100:00100000:0.0:1788651792.549750:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:0.0:1788651792.549761:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125449728:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651792.549831:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125449728:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 72us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651792.549839:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:0.0:1788651792.549857:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:0.0:1788651792.549864:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125449856:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651792.549890:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125449856:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 26us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651792.549897:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:0.0:1788651792.550012:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125449344 00000100:00100000:0.0:1788651792.550017:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125449344 00000100:00100000:0.0:1788651792.550045:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 279 00000100:00100000:0.0:1788651792.550052:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2391:x1875537125449344:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651792.550078:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2391:x1875537125449344:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 26us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651792.550084:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 279 00000100:00100000:0.0:1788651792.550125:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125449472 00000100:00100000:0.0:1788651792.550129:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125449472 00000100:00100000:0.0:1788651792.550156:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125449600 00000100:00100000:0.0:1788651792.550159:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125449600 00000100:00100000:0.0:1788651792.550181:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 82 00000100:00100000:0.0:1788651792.550188:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2391:x1875537125449472:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651792.550215:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2391:x1875537125449472:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 28us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651792.550230:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 82 00000100:00100000:0.0:1788651792.550243:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 83 00000100:00100000:0.0:1788651792.550249:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125449600:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651792.550273:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125449600:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 25us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651792.550278:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 83 00000100:00080000:0.0:1788651792.550814:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651792.550819:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651792.550822:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651792.550824:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651792.864211:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147535232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651792.864277:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651792.864337:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147535232 00000100:00100000:3.0:1788651792.864343:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147535232 00000100:00100000:3.0:1788651792.864381:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788651792.864387:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147535232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651792.864420:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651792.864456:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147535232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651792.864463:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788651792.864502:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147535232:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788651792.864615:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788651793.300727:0:10687:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788651793.889138:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651794.401350:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147535360:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651794.401422:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651794.401514:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147535360 00000100:00100000:0.0:1788651794.401522:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147535360 00000100:00100000:0.0:1788651794.401568:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788651794.401576:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147535360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788651794.401611:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788651794.401763:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147535360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 185us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651794.401770:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788651794.401875:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147535360:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788651794.915400:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651795.936922:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651795.936981:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147535488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651795.937069:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651795.937140:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651795.937151:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147535616:0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.937193:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651795.937237:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147536000:0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.937268:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651795.937272:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147535872:0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.937295:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147536512:0@lo:400:kworker.0 00000100:00100000:0.0:1788651795.937315:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651795.937331:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651795.937341:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147536384:0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.937371:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147537024:0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.937393:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651795.937412:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788651795.937421:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147536128:0@lo:400:kworker.0 00000100:00100000:0.0:1788651795.937438:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651795.937457:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651795.937465:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147536896:0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.937487:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147536640:0@lo:400:kworker.0 00000100:00100000:0.0:1788651795.937494:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651795.937519:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651795.937521:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788651795.937537:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147535744:0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.937554:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147535488 00000100:00100000:3.0:1788651795.937563:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147535488 00000100:00100000:0.0:1788651795.937565:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651795.937585:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147536256:0@lo:400:kworker.0 00000100:00100000:0.0:1788651795.937607:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651795.937619:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147536768:0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.937622:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788651795.937635:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147535488:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651795.937642:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651795.937665:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147536000 00000100:00100000:0.0:1788651795.937669:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147536000 00002000:00000024:3.0:1788651795.937670:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651795.937694:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147536384 00000100:00100000:0.0:1788651795.937698:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147536384 00000100:00100000:0.0:1788651795.937714:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147536896 00000100:00100000:0.0:1788651795.937716:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147536896 00000100:00100000:3.0:1788651795.937723:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147535488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651795.937727:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147535744 00000100:00100000:0.0:1788651795.937730:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147535744 00000100:00100000:3.0:1788651795.937733:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788651795.937740:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147536256 00000100:00100000:0.0:1788651795.937744:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147536256 00000100:00100000:0.0:1788651795.937757:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147536768 00000100:00100000:0.0:1788651795.937760:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147536768 00000100:00100000:3.0:1788651795.937769:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147535616 00000100:00100000:3.0:1788651795.937775:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147535616 00000100:00100000:0.0:1788651795.937776:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788651795.937786:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147536000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.937812:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788651795.937820:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3663800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147536000:12345-0@lo:400:kworker.0 Request processed in 35us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.937823:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147535616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651795.937832:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788651795.937850:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788651795.937858:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147536384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.937866:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147535616:12345-0@lo:400:kworker.0 Request processed in 45us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.937873:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1788651795.937900:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147536384:12345-0@lo:400:kworker.0 Request processed in 43us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.937933:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788651795.937943:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147536896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.937974:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147536896:12345-0@lo:400:kworker.0 Request processed in 33us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.937990:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788651795.938005:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788651795.938010:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147535744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.938051:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147535744:12345-0@lo:400:kworker.0 Request processed in 40us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.938057:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788651795.938082:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788651795.938089:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147536256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.938115:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147536256:12345-0@lo:400:kworker.0 Request processed in 27us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.938120:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788651795.938132:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788651795.938138:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147536768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.938164:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147536768:12345-0@lo:400:kworker.0 Request processed in 26us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.938169:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788651795.938186:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147535872 00000100:00100000:3.0:1788651795.938190:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147535872 00000100:00100000:3.0:1788651795.938213:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147536128 00000100:00100000:3.0:1788651795.938216:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147536128 00000100:00100000:3.0:1788651795.938228:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788651795.938233:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147535872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.938261:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147535872:12345-0@lo:400:kworker.0 Request processed in 28us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.938267:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788651795.938285:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788651795.938291:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147536128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.938319:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147536128:12345-0@lo:400:kworker.0 Request processed in 28us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.938325:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788651795.938342:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147536512 00000100:00100000:3.0:1788651795.938345:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147536512 00000100:00100000:3.0:1788651795.938369:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147537024 00000100:00100000:3.0:1788651795.938372:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147537024 00000100:00100000:3.0:1788651795.938383:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147536640 00000100:00100000:3.0:1788651795.938386:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147536640 00000100:00100000:3.0:1788651795.938400:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788651795.938405:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147536512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.938435:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3663100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147536512:12345-0@lo:400:kworker.0 Request processed in 29us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.938441:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788651795.938452:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788651795.938457:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147537024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.938483:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147537024:12345-0@lo:400:kworker.0 Request processed in 26us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.938489:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788651795.938498:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788651795.938504:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147536640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.938529:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147536640:12345-0@lo:400:kworker.0 Request processed in 26us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651795.938535:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788651795.938584:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147536128:0@lo:400:kworker.0 00010000:00080000:3.0:1788651795.938610:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3108380 x1875537147536640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651795.938623:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147536640:0@lo:400:kworker.0 00010000:00080000:3.0:1788651795.938634:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3109180 x1875537147537024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651795.938642:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147537024:0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.938655:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147536000:0@lo:400:kworker.0 00010000:00080000:3.0:1788651795.938665:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3108000 x1875537147536512/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651795.938673:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147536512:0@lo:400:kworker.0 00000100:00100000:3.0:1788651795.938681:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3108e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147535616:0@lo:400:kworker.0 00010000:00080000:3.0:1788651795.938689:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c310b100 x1875537147535488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651795.938704:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147535488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651795.938734:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651795.938741:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147537152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651795.938768:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651795.938817:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788651795.938857:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788651795.938862:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651795.938865:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651795.938867:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651795.938894:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147535744:0@lo:400:kworker.0 00000100:00100000:0.0:1788651795.938937:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147536256:0@lo:400:kworker.0 00000100:00100000:0.0:1788651795.938950:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147536768:0@lo:400:kworker.0 00000100:00100000:0.0:1788651795.939045:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147535872:0@lo:400:kworker.0 00010000:00080000:0.0:1788651795.939055:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c310bb80 x1875537147536384/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651795.939065:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147536384:0@lo:400:kworker.0 00010000:00080000:0.0:1788651795.939075:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c310a300 x1875537147536896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651811 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651795.939082:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147536896:0@lo:400:kworker.0 00000100:00100000:2.0:1788651795.939229:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147537152 00000100:00100000:2.0:1788651795.939235:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147537152 00000100:00100000:2.0:1788651795.939260:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788651795.939268:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147537152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651795.939282:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651795.939321:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147537152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651795.939327:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1788651795.939412:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c348e680 x1875537147537152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651811 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651795.939426:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147537152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651796.960058:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651796.960085:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147537280:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651796.960165:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651796.960232:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147537280 00000100:00100000:2.0:1788651796.960239:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147537280 00000100:00100000:2.0:1788651796.960283:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788651796.960292:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147537280:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788651796.960320:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651796.960364:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147537280:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651796.960370:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788651796.960408:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c348e680 x1875537147537280/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651796.960427:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147537280:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651796.960781:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651796.960791:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147537408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651796.960827:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651796.960852:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147537408 00000100:00100000:3.0:1788651796.960856:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147537408 00000100:00100000:3.0:1788651796.960879:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788651796.960885:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147537408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651796.960896:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651796.960940:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147537408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651796.960946:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788651796.960972:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c348e680 x1875537147537408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651812 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651796.960985:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147537408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788651796.961137:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651797.669673:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651797.669724:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651797.669747:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651797.669774:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125450240 00000100:00100000:1.0:1788651797.669784:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125450240 00000100:00100000:1.0:1788651797.669839:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125450112 00000100:00100000:1.0:1788651797.669842:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125450112 00000100:00100000:1.0:1788651797.669865:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 90 00000100:00100000:1.0:1788651797.669874:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125450240:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651797.669957:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125450240:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 84us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651797.669975:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 90 00000100:00100000:1.0:1788651797.670003:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 91 00000100:00100000:1.0:1788651797.670014:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125450112:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651797.670042:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125450112:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 29us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651797.670048:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 91 00000100:00080000:1.0:1788651797.670064:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651797.670067:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651797.670406:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125449984 00000100:00100000:3.0:1788651797.670411:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125449984 00000100:00100000:3.0:1788651797.670446:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 281 00000100:00100000:3.0:1788651797.670454:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2388:x1875537125449984:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651797.670481:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2388:x1875537125449984:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 30us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651797.670487:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 281 00000100:00100000:3.0:1788651797.676225:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651797.676315:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651797.685767:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125450368 00000100:00100000:1.0:1788651797.685842:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125450368 00000100:00100000:1.0:1788651797.686296:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125450496 00000100:00100000:1.0:1788651797.686301:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125450496 00000100:00100000:1.0:1788651797.686341:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:1.0:1788651797.686350:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2387:x1875537125450368:12345-192.168.204.45@tcp:9:kworker.0 00000020:00000080:1.0:1788651797.686384:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3c08 00000100:00080000:1.0:1788651797.686394:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f86eeb00800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788651797.686439:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788651797.686591:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+2:2387:x1875537125450368:12345-192.168.204.45@tcp:9:kworker.0 Request processed in 241us (10376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651797.686599:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:1.0:1788651797.686613:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:1.0:1788651797.686619:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fceff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2387:x1875537125450496:12345-192.168.204.45@tcp:9:kworker.0 00000020:00000080:1.0:1788651797.686631:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3c0f 00000100:00080000:1.0:1788651797.686637:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f85c3184000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788651797.686655:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788651797.686725:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fceff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+2:2387:x1875537125450496:12345-192.168.204.45@tcp:9:kworker.0 Request processed in 106us (10410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651797.686732:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00010000:00010000:3.0:1788651797.686928:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788651797.686938:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651797.686942:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788651797.687085:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651797.988588:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147537536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788651797.988667:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651797.988747:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147537536 00000100:00100000:1.0:1788651797.988755:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147537536 00000100:00100000:1.0:1788651797.988800:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788651797.988810:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147537536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651797.988842:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651797.988888:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147537536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651797.988894:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788651797.988957:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147537536:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788651798.002321:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788651798.023595:0:10931:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing yml_node 00010000:00010000:3.0:1788651799.017548:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651799.521586:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147537664:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651799.521700:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651799.522152:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147537664 00000100:00100000:3.0:1788651799.522175:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147537664 00000100:00100000:3.0:1788651799.522235:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788651799.522245:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147537664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788651799.522281:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788651799.524300:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147537664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2047us (2592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651799.524313:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788651799.528166:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147537664:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788651800.034512:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651801.056345:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147537920:0@lo:400:kworker.0 00000100:00100000:2.0:1788651801.056425:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651801.056429:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651801.056439:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147538176:0@lo:400:kworker.0 00000100:00100000:0.0:1788651801.056467:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651801.056475:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147538432:0@lo:400:kworker.0 00000100:00100000:0.0:1788651801.056485:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147538688:0@lo:400:kworker.0 00000100:00100000:2.0:1788651801.056495:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651801.056506:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651801.056523:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147538944:0@lo:400:kworker.0 00000100:00100000:0.0:1788651801.056528:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147539200:0@lo:400:kworker.0 00000100:00100000:2.0:1788651801.056542:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651801.056544:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651801.056561:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:0.0:1788651801.056562:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788651801.056567:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147537792:0@lo:400:kworker.0 00000100:00100000:0.0:1788651801.056567:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147538048:0@lo:400:kworker.0 00000100:00100000:2.0:1788651801.056590:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651801.056590:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651801.056608:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147538304:0@lo:400:kworker.0 00000100:00100000:0.0:1788651801.056608:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147538560:0@lo:400:kworker.0 00000100:00100000:2.0:1788651801.056627:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651801.056627:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651801.056635:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147539072:0@lo:400:kworker.0 00000100:00100000:2.0:1788651801.056651:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147538816:0@lo:400:kworker.0 00000100:00100000:0.0:1788651801.056652:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651801.056669:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651801.056672:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147537920 00000100:00100000:0.0:1788651801.056679:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147537920 00000100:00100000:2.0:1788651801.056681:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147539328:0@lo:400:kworker.0 00000100:00100000:2.0:1788651801.056698:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651801.056713:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147538176 00000100:00100000:0.0:1788651801.056716:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147538176 00000100:00100000:2.0:1788651801.056721:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147538048 00000100:00100000:2.0:1788651801.056724:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147538048 00000100:00100000:0.0:1788651801.056727:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147538432 00000100:00100000:0.0:1788651801.056729:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147538432 00000100:00100000:2.0:1788651801.056743:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147538304 00000100:00100000:0.0:1788651801.056745:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147538944 00000100:00100000:2.0:1788651801.056746:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147538304 00000100:00100000:0.0:1788651801.056747:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147538944 00000100:00100000:0.0:1788651801.056756:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147538560 00000100:00100000:0.0:1788651801.056759:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147538560 00000100:00100000:2.0:1788651801.056760:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788651801.056768:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147538048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651801.056768:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147539072 00000100:00100000:0.0:1788651801.056770:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147539072 00000100:00100000:0.0:1788651801.056780:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788651801.056785:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147537920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651801.056819:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147537920:12345-0@lo:400:kworker.0 Request processed in 33us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651801.056826:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788651801.056828:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147538048:12345-0@lo:400:kworker.0 Request processed in 61us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651801.056833:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788651801.056843:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788651801.056849:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147538176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651801.056854:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788651801.056886:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147538176:12345-0@lo:400:kworker.0 Request processed in 37us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651801.056891:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788651801.056903:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788651801.056946:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147538432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651801.056974:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147538432:12345-0@lo:400:kworker.0 Request processed in 31us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651801.056980:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788651801.056993:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788651801.056999:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147538944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651801.057017:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147538304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651801.057082:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788651801.057091:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147538560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651801.057376:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147538688 00000100:00100000:3.0:1788651801.057384:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147538688 00000100:00100000:3.0:1788651801.057420:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147539200 00000100:00100000:3.0:1788651801.057423:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147539200 00000100:00100000:3.0:1788651801.057433:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147538816 00000100:00100000:3.0:1788651801.057435:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147538816 00000100:00100000:3.0:1788651801.057444:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147539328 00000100:00100000:3.0:1788651801.057446:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147539328 00000100:00100000:3.0:1788651801.057459:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788651801.057470:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147538688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651801.057470:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147538944:12345-0@lo:400:kworker.0 Request processed in 467us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651801.057483:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788651801.057500:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788651801.057507:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147539072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651801.064594:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147538304:12345-0@lo:400:kworker.0 Request processed in 7569us (7957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651801.064610:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788651801.064706:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651801.064721:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147539456:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651801.064762:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651801.064819:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147539456 00000100:00100000:2.0:1788651801.064825:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147539456 00000100:00100000:1.0:1788651801.065518:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147538560:12345-0@lo:400:kworker.0 Request processed in 8426us (8887us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651801.065529:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788651801.065574:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788651801.065585:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1875537147539200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651801.065634:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3636:x1875537147539200:12345-0@lo:400:kworker.0 Request processed in 52us (9088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651801.065658:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788651801.065672:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788651801.065679:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147538816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651801.065713:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147538816:12345-0@lo:400:kworker.0 Request processed in 34us (9042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651801.065718:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788651801.065730:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788651801.065737:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147539328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651801.065765:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147539328:12345-0@lo:400:kworker.0 Request processed in 28us (9066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651801.065771:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788651801.069544:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147538688:12345-0@lo:400:kworker.0 Request processed in 12067us (13025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651801.069655:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788651801.069719:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147537792 00000100:00100000:3.0:1788651801.069729:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147537792 00000100:00100000:3.0:1788651801.069778:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788651801.069787:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147537792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651801.069839:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147537792:12345-0@lo:400:kworker.0 Request processed in 53us (13247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651801.069845:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00080000:3.0:1788651801.069873:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651801.069890:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651801.069893:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651801.069896:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651801.070043:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147539584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651801.070499:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651801.070548:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147539584 00000100:00100000:3.0:1788651801.070553:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147539584 00000100:00100000:0.0:1788651801.070761:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147539072:12345-0@lo:400:kworker.0 Request processed in 13252us (14104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651801.070771:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788651801.070876:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147538048:0@lo:400:kworker.0 00010000:00080000:0.0:1788651801.070894:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3458380 x1875537147538560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651801.070934:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147538560:0@lo:400:kworker.0 00010000:00080000:0.0:1788651801.070947:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff444a80 x1875537147539072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651801.070971:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147539072:0@lo:400:kworker.0 00000100:00100000:0.0:1788651801.070985:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147538176:0@lo:400:kworker.0 00010000:00080000:0.0:1788651801.070995:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff446680 x1875537147538688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651801.071002:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147538688:0@lo:400:kworker.0 00010000:00080000:0.0:1788651801.071012:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff445180 x1875537147539200/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651801.071018:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147539200:0@lo:400:kworker.0 00000100:00100000:1.0:1788651801.071680:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147537792:0@lo:400:kworker.0 00000100:00100000:1.0:1788651801.071696:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147538304:0@lo:400:kworker.0 00010000:00080000:1.0:1788651801.071709:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff445c00 x1875537147538816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651801.071717:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147538816:0@lo:400:kworker.0 00010000:00080000:1.0:1788651801.071727:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff446300 x1875537147539328/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651817 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651801.071734:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147539328:0@lo:400:kworker.0 00000100:00100000:1.0:1788651801.071745:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147538944:0@lo:400:kworker.0 00000100:00100000:1.0:1788651801.071756:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147537920:0@lo:400:kworker.0 00000100:00100000:1.0:1788651801.071767:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147538432:0@lo:400:kworker.0 00000100:00100000:2.0:1788651801.074111:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788651801.074204:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147539456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651801.074242:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651801.074629:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147539456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 506us (9866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651801.074650:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788651801.074741:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5ad80 x1875537147539456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651801.074762:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147539456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651801.074818:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788651801.074829:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147539584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651801.074844:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651801.074898:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3661180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147539584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (4400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651801.075661:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788651801.075878:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3660a80 x1875537147539584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651817 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651801.075897:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3660a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147539584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788651802.083220:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651802.083292:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651802.083311:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147539712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651802.083379:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651802.083454:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147539712 00000100:00100000:3.0:1788651802.083461:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147539712 00000100:00100000:3.0:1788651802.083517:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788651802.083527:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147539712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651802.083569:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651802.083617:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147539712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651802.083624:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788651802.083665:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3662300 x1875537147539712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651802.083685:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3662300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147539712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651802.087037:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651802.087062:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147539840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651802.087131:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651802.087202:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147539840 00000100:00100000:2.0:1788651802.087211:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147539840 00000100:00100000:2.0:1788651802.087265:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788651802.087273:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147539840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788651802.087304:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651802.087364:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147539840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651802.087371:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788651802.087412:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36f5180 x1875537147539840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651802.087431:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147539840:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788651802.632745:0:11114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00000100:00100000:3.0:1788651802.787524:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651802.787558:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651802.787586:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651802.787625:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125450624 00000100:00100000:3.0:1788651802.787636:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125450624 00000100:00100000:1.0:1788651802.787665:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125450880 00000100:00100000:1.0:1788651802.787669:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125450880 00000100:00100000:3.0:1788651802.787687:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 283 00000100:00100000:3.0:1788651802.787698:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2389:x1875537125450624:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651802.787707:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125450752 00000100:00100000:1.0:1788651802.787709:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125450752 00000100:00100000:1.0:1788651802.787725:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 98 00000100:00100000:1.0:1788651802.787731:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125450880:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651802.787767:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2389:x1875537125450624:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 70us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651802.787775:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 283 00000100:00100000:3.0:1788651802.787824:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 99 00000100:00100000:3.0:1788651802.787832:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125450752:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651802.788215:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125450880:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 482us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651802.788223:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 98 00000100:00100000:3.0:1788651802.792093:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3663100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125450752:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 4247us (4491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651802.792107:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 99 00000100:00080000:3.0:1788651802.792155:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651802.792161:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651803.104079:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147539968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788651803.104203:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651803.104285:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147539968 00000100:00100000:1.0:1788651803.104293:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147539968 00000100:00100000:1.0:1788651803.104343:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788651803.104352:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147539968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651803.104389:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651803.104443:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147539968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651803.104450:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788651803.104512:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147539968:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788651803.105227:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788651803.107571:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:1.0:1788651803.107581:0:9506:0:(genops.c:885:class_export_put()) final put ffff8f85c3181000/72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:3.0:1788651803.107752:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3181000/72121fb7-fb91-4477-92d5-4e7fe3e6b65d for lustre-OST0001 00000020:00000080:3.0:1788651803.107806:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3184000 for lustre-OST0001 00000001:00100000:0.0:1788651803.108465:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:0.0:1788651803.108471:0:8422:0:(genops.c:885:class_export_put()) final put ffff8f86eeb00000/72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:2.0:1788651803.108532:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86eeb00000/72121fb7-fb91-4477-92d5-4e7fe3e6b65d for lustre-OST0000 00000020:00000080:2.0:1788651803.108639:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86eeb00800 for lustre-OST0000 00010000:00010000:0.0:1788651804.128045:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651804.640270:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147540096:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651804.640345:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651804.640532:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147540096 00000100:00100000:1.0:1788651804.640542:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147540096 00000100:00100000:1.0:1788651804.640594:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788651804.640603:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147540096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651804.640634:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788651804.640785:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147540096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 182us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651804.640792:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788651804.643540:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147540096:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788651805.152172:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788651805.364148:0:11212:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00000100:00100000:0.0:1788651806.176301:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147540224:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.176378:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651806.176431:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147540736:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.176456:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651806.176476:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147541248:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.176499:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651806.176518:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147541760:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.176548:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651806.176575:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788651806.176581:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147540608:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.176630:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788651806.177302:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651806.177315:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147540480:0@lo:400:kworker.0 00000100:00100000:1.0:1788651806.177349:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651806.177369:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147540992:0@lo:400:kworker.0 00000100:00100000:1.0:1788651806.177396:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147540352:0@lo:400:kworker.0 00000100:00100000:1.0:1788651806.177455:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147540736 00000100:00100000:1.0:1788651806.177462:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147540736 00000100:00100000:1.0:1788651806.177500:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147540480 00000100:00100000:1.0:1788651806.177503:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147540480 00000100:00100000:1.0:1788651806.177518:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788651806.177526:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147540736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651806.177576:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147540736:12345-0@lo:400:kworker.0 Request processed in 50us (1118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651806.177593:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788651806.178052:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788651806.178061:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147540480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651806.178103:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147540480:12345-0@lo:400:kworker.0 Request processed in 44us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651806.178110:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788651806.178333:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147541120:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.178362:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651806.178381:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147541632:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.178401:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651806.178432:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147540736:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.178460:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147541248 00000100:00100000:0.0:1788651806.178465:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147541248 00000100:00100000:0.0:1788651806.178496:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147541760 00000100:00100000:0.0:1788651806.178500:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147541760 00000100:00100000:0.0:1788651806.178512:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147541120 00000100:00100000:0.0:1788651806.178514:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147541120 00000100:00100000:0.0:1788651806.178526:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147541632 00000100:00100000:0.0:1788651806.178528:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147541632 00000100:00100000:0.0:1788651806.178540:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788651806.178547:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147541248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.178586:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147541248:12345-0@lo:400:kworker.0 Request processed in 39us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651806.178592:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788651806.178760:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147540224 00000100:00100000:1.0:1788651806.178766:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147540224 00000100:00100000:1.0:1788651806.178812:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788651806.178820:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147540224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651806.178865:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147540224:12345-0@lo:400:kworker.0 Request processed in 46us (2488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651806.178872:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788651806.178928:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651806.179180:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788651806.179190:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147541760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.179222:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147541760:12345-0@lo:400:kworker.0 Request processed in 36us (2673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651806.179228:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788651806.179249:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788651806.179254:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147541120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.179299:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147541120:12345-0@lo:400:kworker.0 Request processed in 45us (937us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651806.179305:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788651806.179316:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788651806.179321:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147541632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.179345:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147541632:12345-0@lo:400:kworker.0 Request processed in 24us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651806.179350:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788651806.179404:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147541504:0@lo:400:kworker.0 00000100:00100000:1.0:1788651806.179430:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651806.184638:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147542016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651806.184704:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651806.184746:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147540480:0@lo:400:kworker.0 00000100:00100000:2.0:1788651806.184858:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147540608 00000100:00100000:2.0:1788651806.184865:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147540608 00000100:00100000:2.0:1788651806.184919:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147540992 00000100:00100000:2.0:1788651806.184922:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147540992 00000100:00100000:2.0:1788651806.184949:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147541504 00000100:00100000:2.0:1788651806.184952:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147541504 00000100:00100000:2.0:1788651806.184968:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788651806.184976:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147540608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651806.185030:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147540608:12345-0@lo:400:kworker.0 Request processed in 54us (8399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651806.185036:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788651806.185064:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788651806.185069:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147540992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651806.185104:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147540992:12345-0@lo:400:kworker.0 Request processed in 35us (6175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651806.185110:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788651806.185121:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788651806.185127:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147541504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651806.185163:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147541504:12345-0@lo:400:kworker.0 Request processed in 37us (5732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651806.185169:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788651806.185186:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147542016 00000100:00100000:2.0:1788651806.185189:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147542016 00000100:00100000:2.0:1788651806.185211:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788651806.185217:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147542016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651806.185239:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651806.185271:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147542016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651806.185277:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788651806.185310:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a58e00 x1875537147542016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651806.185325:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147542016:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788651806.185337:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff445500 x1875537147540992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651806.185345:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147540992:0@lo:400:kworker.0 00010000:00080000:2.0:1788651806.185354:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff446300 x1875537147541504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651806.185368:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147541504:0@lo:400:kworker.0 00000100:00080000:0.0:1788651806.185758:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651806.185764:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651806.185766:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651806.185779:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651806.185807:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147540864:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.189064:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651806.189118:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147541376:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.189216:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651806.189238:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147541888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651806.189265:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651806.189313:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147540352 00000100:00100000:0.0:1788651806.189320:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147540352 00000100:00100000:0.0:1788651806.189355:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147540864 00000100:00100000:0.0:1788651806.189358:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147540864 00000100:00100000:0.0:1788651806.189379:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147541376 00000100:00100000:0.0:1788651806.189382:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147541376 00000100:00100000:0.0:1788651806.189396:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788651806.189404:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147540352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.189462:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147540352:12345-0@lo:400:kworker.0 Request processed in 58us (3682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651806.189470:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788651806.189488:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788651806.189494:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147540864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.189522:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147540864:12345-0@lo:400:kworker.0 Request processed in 29us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651806.189529:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788651806.189540:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788651806.189545:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147541376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.189572:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147541376:12345-0@lo:400:kworker.0 Request processed in 27us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651806.189578:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788651806.189600:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147541888 00000100:00100000:0.0:1788651806.189604:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147541888 00000100:00100000:0.0:1788651806.189631:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788651806.189637:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147541888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651806.189655:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651806.189686:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147541888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651806.189693:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:0.0:1788651806.189708:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651806.189740:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147540352:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.189752:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147540864:0@lo:400:kworker.0 00000100:00100000:0.0:1788651806.189761:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147541376:0@lo:400:kworker.0 00010000:00080000:0.0:1788651806.189783:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36f7480 x1875537147541888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651822 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651806.189799:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147541888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651806.190118:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147540608:0@lo:400:kworker.0 00010000:00080000:1.0:1788651806.190133:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff447800 x1875537147541120/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651806.190212:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147541120:0@lo:400:kworker.0 00010000:00080000:1.0:1788651806.190227:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff445c00 x1875537147541632/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651806.190241:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147541632:0@lo:400:kworker.0 00000100:00100000:1.0:1788651806.190253:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147540224:0@lo:400:kworker.0 00010000:00080000:1.0:1788651806.190263:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff447100 x1875537147541248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651806.190270:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147541248:0@lo:400:kworker.0 00010000:00080000:1.0:1788651806.190279:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c345b100 x1875537147541760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651822 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651806.190286:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147541760:0@lo:400:kworker.0 00000100:00100000:1.0:1788651807.200195:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147542144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651807.200276:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651807.200390:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651807.200397:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147542272:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651807.200421:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651807.200999:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147542144 00000100:00100000:0.0:1788651807.201007:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147542144 00000100:00100000:0.0:1788651807.201048:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147542272 00000100:00100000:0.0:1788651807.201051:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147542272 00000100:00100000:0.0:1788651807.201066:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788651807.201074:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147542144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651807.201105:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651807.201342:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147542144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 267us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651807.201350:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788651807.201370:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788651807.201378:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147542272:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788651807.201392:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651807.201426:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147542272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651807.201432:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788651807.201508:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36f6a00 x1875537147542272/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651807.201528:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147542272:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788651807.201541:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3660700 x1875537147542144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651807.201553:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147542144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788651807.201734:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788651807.777502:0:11309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:1.0:1788651807.907397:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651807.907444:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651807.907487:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651807.907519:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125451264 00000100:00100000:1.0:1788651807.907529:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125451264 00000100:00100000:1.0:1788651807.907581:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125451136 00000100:00100000:1.0:1788651807.907585:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125451136 00000100:00100000:1.0:1788651807.907606:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 106 00000100:00100000:1.0:1788651807.907615:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125451264:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651807.907686:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125451264:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 71us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651807.907693:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 106 00000100:00100000:1.0:1788651807.907710:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 107 00000100:00100000:1.0:1788651807.907716:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2391:x1875537125451136:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651807.907739:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2391:x1875537125451136:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 24us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651807.907745:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 107 00000100:00080000:1.0:1788651807.907760:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651807.907763:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788651807.907936:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125451008 00000100:00100000:2.0:1788651807.907941:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125451008 00000100:00100000:2.0:1788651807.907973:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 285 00000100:00100000:2.0:1788651807.907981:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2391:x1875537125451008:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651807.908026:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2391:x1875537125451008:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 45us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651807.908033:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 285 00000100:00100000:0.0:1788651808.224487:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147542400:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788651808.224562:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651808.224703:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651808.225028:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147542400 00000100:00100000:1.0:1788651808.225037:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147542400 00000100:00100000:1.0:1788651808.225088:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788651808.225097:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147542400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651808.225128:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651808.225201:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147542400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651808.225209:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788651808.225296:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147542400:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788651809.248263:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788651809.531893:0:11357:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 19:43:27 EDT 2026 00000100:00100000:3.0:1788651809.763110:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147542528:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651809.763217:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651809.763648:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147542528 00000100:00100000:0.0:1788651809.763657:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147542528 00000100:00100000:0.0:1788651809.763712:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788651809.763728:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147542528:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788651809.763781:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788651809.763838:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147542528:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651809.763845:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788651809.764005:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147542528:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788651810.274542:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651811.297083:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651811.297242:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147542784:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297301:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297345:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147543296:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297362:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297377:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147543808:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297391:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297468:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:0.0:1788651811.297478:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147542656:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297505:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297522:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147543168:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297539:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297551:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147543680:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297568:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297579:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147544192:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297593:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297612:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147542912:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297628:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297639:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147543424:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297664:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297819:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147543936:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297838:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297848:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788651811.297853:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147543040:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297867:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297873:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147543552:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297887:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297898:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147544064:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.297934:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651811.297961:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147542784 00000100:00100000:0.0:1788651811.297969:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147542784 00000100:00100000:0.0:1788651811.298001:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147543296 00000100:00100000:0.0:1788651811.298003:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147543296 00000100:00100000:0.0:1788651811.298019:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147543808 00000100:00100000:0.0:1788651811.298021:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147543808 00000100:00100000:0.0:1788651811.298032:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147543424 00000100:00100000:0.0:1788651811.298033:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147543424 00000100:00100000:0.0:1788651811.298042:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147543936 00000100:00100000:0.0:1788651811.298043:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147543936 00000100:00100000:0.0:1788651811.298052:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147543040 00000100:00100000:0.0:1788651811.298054:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147543040 00000100:00100000:0.0:1788651811.298064:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788651811.298071:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147542784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.298168:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147542784:12345-0@lo:400:kworker.0 Request processed in 96us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651811.298175:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788651811.298196:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788651811.298207:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147543296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.298235:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147543296:12345-0@lo:400:kworker.0 Request processed in 29us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651811.298241:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788651811.298252:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788651811.298257:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147543808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.298277:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147543808:12345-0@lo:400:kworker.0 Request processed in 21us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651811.298282:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788651811.298290:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788651811.298295:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147543424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.298316:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147543424:12345-0@lo:400:kworker.0 Request processed in 21us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651811.298322:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788651811.298330:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788651811.298334:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147543936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.298352:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147543936:12345-0@lo:400:kworker.0 Request processed in 18us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651811.298357:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788651811.298365:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788651811.298369:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147543040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.298386:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147543040:12345-0@lo:400:kworker.0 Request processed in 17us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651811.298391:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788651811.298406:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147543168 00000100:00100000:0.0:1788651811.298415:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147543168 00000100:00100000:0.0:1788651811.298433:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147542912 00000100:00100000:0.0:1788651811.298435:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147542912 00000100:00100000:0.0:1788651811.298444:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788651811.298449:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147543168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.298474:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147543168:12345-0@lo:400:kworker.0 Request processed in 25us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651811.298479:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788651811.298488:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788651811.298492:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147542912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.298571:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651811.298583:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147544320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651811.298615:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651811.298651:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147542656 00000100:00100000:1.0:1788651811.298654:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147542656 00000100:00100000:1.0:1788651811.298691:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788651811.298697:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147542656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.298722:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147542656:12345-0@lo:400:kworker.0 Request processed in 26us (1217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651811.298738:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00080000:1.0:1788651811.298759:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788651811.298763:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651811.298774:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147544320 00000100:00100000:1.0:1788651811.298777:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147544320 00000100:00100000:1.0:1788651811.298800:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788651811.298805:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147544320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651811.298825:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651811.298851:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147544320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651811.298857:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788651811.298872:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788651811.298892:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d5180 x1875537147544320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651811.298932:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147544320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651811.299050:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147543680 00000100:00100000:1.0:1788651811.299054:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147543680 00000100:00100000:1.0:1788651811.299073:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147544192 00000100:00100000:1.0:1788651811.299075:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147544192 00000100:00100000:1.0:1788651811.299090:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147543552 00000100:00100000:1.0:1788651811.299092:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147543552 00000100:00100000:1.0:1788651811.299101:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147544064 00000100:00100000:1.0:1788651811.299103:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147544064 00000100:00100000:1.0:1788651811.299126:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788651811.299132:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147543680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.299159:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147543680:12345-0@lo:400:kworker.0 Request processed in 28us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651811.299165:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788651811.299174:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788651811.299178:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147544192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.299196:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147544192:12345-0@lo:400:kworker.0 Request processed in 18us (1602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651811.299201:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788651811.299208:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788651811.299212:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147543552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.299234:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147543552:12345-0@lo:400:kworker.0 Request processed in 21us (1346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651811.299239:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788651811.299247:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788651811.299252:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147544064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.299272:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147544064:12345-0@lo:400:kworker.0 Request processed in 20us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651811.299277:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788651811.299290:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651811.299292:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651811.299322:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147542656:0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.299339:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147543168:0@lo:400:kworker.0 00010000:00080000:1.0:1788651811.299348:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb11880 x1875537147543680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651811.299356:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147543680:0@lo:400:kworker.0 00010000:00080000:1.0:1788651811.299364:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb11500 x1875537147544192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651811.299372:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147544192:0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.299380:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147542784:0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.299389:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147543296:0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.299397:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147543808:0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.299435:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147543040:0@lo:400:kworker.0 00010000:00080000:1.0:1788651811.299448:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb11f80 x1875537147543552/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651811.299457:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147543552:0@lo:400:kworker.0 00010000:00080000:1.0:1788651811.299468:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb12d80 x1875537147544064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651811.299476:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147544064:0@lo:400:kworker.0 00010000:00080000:1.0:1788651811.299486:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff446a00 x1875537147543424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651811.299494:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147543424:0@lo:400:kworker.0 00000100:00100000:0.0:1788651811.299838:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147542912:12345-0@lo:400:kworker.0 Request processed in 1344us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651811.299845:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1788651811.299898:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb10e00 x1875537147543936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651827 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651811.299933:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147543936:0@lo:400:kworker.0 00000100:00100000:1.0:1788651811.299966:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147542912:0@lo:400:kworker.0 00000100:00100000:3.0:1788651811.299970:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651811.299985:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147544448:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651811.300026:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651811.300862:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147544448 00000100:00100000:1.0:1788651811.300870:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147544448 00000100:00100000:1.0:1788651811.300936:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788651811.300945:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147544448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788651811.300972:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651811.301028:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147544448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651811.301034:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788651811.301107:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3660700 x1875537147544448/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651827 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651811.301192:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3660700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147544448:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788651812.320348:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651812.320875:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651812.320895:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147544576:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651812.321000:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651812.321066:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147544576 00000100:00100000:2.0:1788651812.321074:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147544576 00000100:00100000:2.0:1788651812.321115:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788651812.321124:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147544576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788651812.321151:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651812.321195:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147544576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651812.321201:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788651812.321254:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a58e00 x1875537147544576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651812.321286:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147544576:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651812.326489:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147544704:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651812.326561:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651812.326629:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147544704 00000100:00100000:3.0:1788651812.326636:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147544704 00000100:00100000:3.0:1788651812.326757:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788651812.326767:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147544704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651812.326789:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651812.326835:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147544704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651812.326843:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788651812.326879:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c310a680 x1875537147544704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651812.326898:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147544704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651813.029846:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651813.029887:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651813.029972:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651813.030141:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125451648 00000100:00100000:2.0:1788651813.030150:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125451520 00000100:00100000:0.0:1788651813.030161:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125451648 00000100:00100000:2.0:1788651813.030172:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125451520 00000100:00100000:3.0:1788651813.030229:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125451392 00000100:00100000:3.0:1788651813.030244:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125451392 00000100:00100000:3.0:1788651813.030301:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 287 00000100:00100000:3.0:1788651813.030312:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2390:x1875537125451392:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651813.030395:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2390:x1875537125451392:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 84us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651813.030404:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 287 00000100:00100000:2.0:1788651813.030820:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 114 00000100:00100000:2.0:1788651813.030829:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125451520:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651813.030873:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125451520:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 46us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651813.030880:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 114 00000100:00100000:0.0:1788651813.030954:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 115 00000100:00100000:0.0:1788651813.030966:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125451648:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651813.031019:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125451648:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 57us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651813.031026:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 115 00000100:00080000:1.0:1788651813.033251:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651813.033259:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788651813.345740:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651813.346040:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147544832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651813.346111:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651813.346341:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147544832 00000100:00100000:1.0:1788651813.346349:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147544832 00000100:00100000:1.0:1788651813.346399:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788651813.346409:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147544832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651813.346442:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651813.346496:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147544832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651813.346503:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788651813.346587:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147544832:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788651814.368150:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651814.882092:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147544960:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651814.882164:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651814.882246:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147544960 00000100:00100000:2.0:1788651814.882254:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147544960 00000100:00100000:2.0:1788651814.882308:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788651814.882317:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147544960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788651814.882350:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788651814.882396:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147544960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651814.882403:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788651814.882453:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147544960:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788651815.395671:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651816.416386:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147545216:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651816.416459:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651816.416541:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147545216 00000100:00100000:1.0:1788651816.416549:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147545216 00000100:00100000:1.0:1788651816.416603:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788651816.416613:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147545216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651816.416654:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651816.416701:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147545216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651816.416709:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788651816.416730:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788651816.416763:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff445180 x1875537147545216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651816.416782:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147545216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651816.416938:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651816.416951:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147545088:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651816.416984:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651816.417359:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147545088 00000100:00100000:1.0:1788651816.417365:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147545088 00000100:00100000:1.0:1788651816.417418:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788651816.417425:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147545088:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788651816.417437:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651816.417476:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147545088:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651816.417482:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788651816.417511:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c310bb80 x1875537147545088/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651832 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651816.417526:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147545088:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788651816.417878:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788651816.417931:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788651816.418388:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147545600:0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.418443:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651816.418475:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147546112:0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.418504:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651816.418533:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147546624:0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.418557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651816.418580:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788651816.418586:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147545472:0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.418610:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651816.418640:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147545984:0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.418662:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651816.418678:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147546496:0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.418700:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651816.418724:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147545600 00000100:00100000:1.0:1788651816.418728:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147545600 00000100:00100000:1.0:1788651816.418762:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788651816.418770:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147545600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.418817:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147545600:12345-0@lo:400:kworker.0 Request processed in 47us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651816.418824:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788651816.418843:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147546112 00000100:00100000:1.0:1788651816.418847:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147546112 00000100:00100000:1.0:1788651816.418874:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147546624 00000100:00100000:1.0:1788651816.418877:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147546624 00000100:00100000:1.0:1788651816.418889:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147545472 00000100:00100000:1.0:1788651816.418892:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147545472 00000100:00100000:1.0:1788651816.418901:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147545984 00000100:00100000:1.0:1788651816.418903:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147545984 00000100:00100000:1.0:1788651816.418949:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147546496 00000100:00100000:1.0:1788651816.418952:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147546496 00000100:00100000:1.0:1788651816.418967:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788651816.418973:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147546112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.419004:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147546112:12345-0@lo:400:kworker.0 Request processed in 31us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651816.419130:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147545344:0@lo:400:kworker.0 00000100:00100000:3.0:1788651816.419165:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651816.419203:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147545856:0@lo:400:kworker.0 00000100:00100000:3.0:1788651816.419226:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651816.419243:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147546368:0@lo:400:kworker.0 00000100:00100000:3.0:1788651816.419266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651816.419288:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788651816.419294:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147545728:0@lo:400:kworker.0 00000100:00100000:3.0:1788651816.419316:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651816.419327:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147546240:0@lo:400:kworker.0 00000100:00100000:3.0:1788651816.419345:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651816.419411:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147545344 00000100:00100000:0.0:1788651816.419416:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147545344 00000100:00100000:0.0:1788651816.419454:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788651816.419462:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147545344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651816.419498:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147545344:12345-0@lo:400:kworker.0 Request processed in 37us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651816.419510:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1788651816.419617:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147545344:0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.419810:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788651816.419825:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147545728 00000100:00100000:1.0:1788651816.419828:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147545728 00000100:00100000:1.0:1788651816.419844:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788651816.419851:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147546624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.419884:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147546624:12345-0@lo:400:kworker.0 Request processed in 34us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651816.419890:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788651816.419902:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788651816.419942:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147545472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.419972:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147545472:12345-0@lo:400:kworker.0 Request processed in 64us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651816.419978:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788651816.419990:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788651816.419996:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147545984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.420041:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147545984:12345-0@lo:400:kworker.0 Request processed in 41us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651816.420046:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788651816.420058:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788651816.420065:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147546496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.420105:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147546496:12345-0@lo:400:kworker.0 Request processed in 41us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651816.420111:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788651816.420124:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788651816.420130:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147545728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.420170:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147545728:12345-0@lo:400:kworker.0 Request processed in 40us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651816.420176:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788651816.420206:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147546368 00000100:00100000:1.0:1788651816.420210:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147546368 00000100:00100000:1.0:1788651816.420233:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147546240 00000100:00100000:1.0:1788651816.420236:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147546240 00000100:00100000:1.0:1788651816.420257:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788651816.420264:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147546368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.420295:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147546368:12345-0@lo:400:kworker.0 Request processed in 32us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651816.420301:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788651816.420313:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788651816.420319:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147546240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.420345:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147546240:12345-0@lo:400:kworker.0 Request processed in 27us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651816.420350:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788651816.420374:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651816.420379:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651816.420381:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651816.420405:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147545472:0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.420428:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147545984:0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.420437:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147546496:0@lo:400:kworker.0 00000100:00100000:1.0:1788651816.420446:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147545600:0@lo:400:kworker.0 00010000:00080000:1.0:1788651816.420458:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d1c00 x1875537147546112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651816.420467:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147546112:0@lo:400:kworker.0 00010000:00080000:1.0:1788651816.420477:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2830000 x1875537147546624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651816.420485:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147546624:0@lo:400:kworker.0 00000100:00100000:2.0:1788651816.420588:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147545856 00000100:00100000:2.0:1788651816.420593:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147545856 00000100:00100000:2.0:1788651816.420637:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788651816.420645:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147545856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651816.420680:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147545856:12345-0@lo:400:kworker.0 Request processed in 36us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651816.420686:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788651816.420992:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147545728:0@lo:400:kworker.0 00010000:00080000:3.0:1788651816.421006:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d1f80 x1875537147546240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651816.421025:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147546240:0@lo:400:kworker.0 00000100:00100000:3.0:1788651816.421047:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147545856:0@lo:400:kworker.0 00010000:00080000:3.0:1788651816.421058:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ea15e300 x1875537147546368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651832 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651816.421067:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147546368:0@lo:400:kworker.0 00000100:00100000:2.0:1788651817.448181:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147546752:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651817.448254:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651817.448316:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651817.448324:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147546880:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651817.448351:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651817.448396:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147546752 00000100:00100000:2.0:1788651817.448403:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147546752 00000100:00100000:2.0:1788651817.448443:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147546880 00000100:00100000:2.0:1788651817.448446:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147546880 00000100:00100000:2.0:1788651817.448465:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788651817.448474:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147546752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651817.448507:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651817.448557:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147546752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651817.448565:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788651817.448583:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788651817.448590:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147546880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788651817.448601:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651817.448639:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147546880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651817.448656:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788651817.448699:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5aa00 x1875537147546880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651817.448718:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147546880:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788651817.448729:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5b800 x1875537147546752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651817.448739:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147546752:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788651817.456707:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651818.146758:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651818.146811:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651818.146843:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651818.146949:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125452032 00000100:00100000:2.0:1788651818.146959:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125452032 00000100:00100000:2.0:1788651818.147028:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125451904 00000100:00100000:2.0:1788651818.147032:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125451904 00000100:00100000:2.0:1788651818.147057:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 122 00000100:00100000:2.0:1788651818.147066:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125452032:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651818.147131:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125452032:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 66us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651818.147138:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 122 00000100:00100000:2.0:1788651818.147153:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 123 00000100:00100000:2.0:1788651818.147158:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2391:x1875537125451904:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651818.147177:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2391:x1875537125451904:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 19us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651818.147182:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 123 00000100:00080000:3.0:1788651818.147569:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651818.147574:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651818.148136:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125451776 00000100:00100000:1.0:1788651818.148144:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125451776 00000100:00100000:1.0:1788651818.148188:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 289 00000100:00100000:1.0:1788651818.148196:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2391:x1875537125451776:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651818.148251:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2391:x1875537125451776:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 55us (1505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651818.148257:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 289 00010000:00010000:3.0:1788651818.464354:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651818.464876:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147547008:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788651818.464975:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651818.465153:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147547008 00000100:00100000:1.0:1788651818.465161:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147547008 00000100:00100000:1.0:1788651818.465219:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788651818.465229:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147547008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651818.465265:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651818.465329:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147547008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 101us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651818.465345:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788651818.465406:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147547008:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788651819.488820:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651820.000222:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147547136:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651820.000299:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651820.000667:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147547136 00000100:00100000:2.0:1788651820.000677:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147547136 00000100:00100000:2.0:1788651820.000731:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788651820.000750:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147547136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788651820.000793:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788651820.000850:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147547136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651820.000857:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788651820.000963:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147547136:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788651820.513089:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651821.536194:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147547520:0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.536277:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147547264:0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.536286:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651821.536335:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147548032:0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.536362:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651821.536385:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147548544:0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.536406:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651821.536432:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788651821.536437:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147547648:0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.536456:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651821.536472:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147548160:0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.536495:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651821.536511:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147548672:0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.536542:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651821.536583:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147547520 00000100:00100000:1.0:1788651821.536590:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147547520 00000100:00100000:1.0:1788651821.536634:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788651821.536644:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1394050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147547520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.536696:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1394050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147547520:12345-0@lo:400:kworker.0 Request processed in 54us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651821.536703:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788651821.537114:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147548032 00000100:00100000:1.0:1788651821.537120:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147548032 00000100:00100000:1.0:1788651821.537163:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147548544 00000100:00100000:1.0:1788651821.537166:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147548544 00000100:00100000:1.0:1788651821.537178:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147547648 00000100:00100000:1.0:1788651821.537180:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147547648 00000100:00100000:1.0:1788651821.537193:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788651821.537199:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147548032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.537233:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147548032:12345-0@lo:400:kworker.0 Request processed in 34us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651821.537239:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788651821.537253:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788651821.537260:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147548544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.537302:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147548544:12345-0@lo:400:kworker.0 Request processed in 43us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651821.537309:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788651821.537315:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651821.537324:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788651821.537331:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147547648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.537356:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147547776:0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.537364:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147547648:12345-0@lo:400:kworker.0 Request processed in 33us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651821.537370:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788651821.537392:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147548160 00000100:00100000:1.0:1788651821.537396:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147548160 00000100:00100000:1.0:1788651821.537419:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147548672 00000100:00100000:1.0:1788651821.537421:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147548672 00000100:00100000:2.0:1788651821.537439:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651821.537441:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788651821.537450:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147548160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.537467:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147548288:0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.537488:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147548160:12345-0@lo:400:kworker.0 Request processed in 37us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651821.537501:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651821.537509:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788651821.537521:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788651821.537539:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147548672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.537569:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147548672:12345-0@lo:400:kworker.0 Request processed in 43us (1027us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651821.537575:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1788651821.537616:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651821.537620:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651821.537623:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651821.537657:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147547648:0@lo:400:kworker.0 00010000:00080000:1.0:1788651821.537672:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34adf80 x1875537147548160/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651821.537683:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147548160:0@lo:400:kworker.0 00010000:00080000:1.0:1788651821.537694:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3589500 x1875537147548672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651821.537702:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147548672:0@lo:400:kworker.0 00000100:00100000:1.0:1788651821.537711:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147547520:0@lo:400:kworker.0 00010000:00080000:1.0:1788651821.537719:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34afb80 x1875537147548032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651821.537728:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147548032:0@lo:400:kworker.0 00010000:00080000:1.0:1788651821.537737:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34ad180 x1875537147548544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651821.537745:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147548544:0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.537826:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c358b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147548800:0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.537850:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651821.537873:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1788651821.537880:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147547392:0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.537902:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651821.537943:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147547904:0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.537968:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651821.537990:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147548288 00000100:00100000:2.0:1788651821.537991:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147548416:0@lo:400:kworker.0 00000100:00100000:0.0:1788651821.537997:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147548288 00000100:00100000:2.0:1788651821.538018:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651821.538039:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147548928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651821.538042:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147548800 00000100:00100000:0.0:1788651821.538047:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147548800 00000100:00100000:0.0:1788651821.538068:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788651821.538069:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651821.538079:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147548288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.538107:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147547392 00000100:00100000:2.0:1788651821.538121:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147547392 00000100:00100000:0.0:1788651821.538127:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147548288:12345-0@lo:400:kworker.0 Request processed in 49us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651821.538134:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788651821.538146:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147547904 00000100:00100000:2.0:1788651821.538150:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147547904 00000100:00100000:0.0:1788651821.538153:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788651821.538161:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147548800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.538171:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147548416 00000100:00100000:2.0:1788651821.538176:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147548416 00000100:00100000:0.0:1788651821.538193:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147548800:12345-0@lo:400:kworker.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651821.538198:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788651821.538201:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788651821.538211:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147547392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651821.538227:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651821.538238:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147549056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651821.538252:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147547392:12345-0@lo:400:kworker.0 Request processed in 44us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651821.538260:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788651821.538269:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651821.538277:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788651821.538287:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147547904:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788651821.538296:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651821.538300:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651821.538301:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788651821.538341:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651821.538381:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147547904:12345-0@lo:400:kworker.0 Request processed in 96us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651821.538388:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788651821.538400:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788651821.538406:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147548416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.538431:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147548416:12345-0@lo:400:kworker.0 Request processed in 26us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651821.538436:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788651821.538453:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147547776 00000100:00100000:2.0:1788651821.538457:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147547776 00000100:00100000:2.0:1788651821.538489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788651821.538495:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147547776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.538691:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147547776:12345-0@lo:400:kworker.0 Request processed in 196us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651821.538698:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788651821.538725:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147547264 00000100:00100000:2.0:1788651821.538729:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147547264 00000100:00100000:2.0:1788651821.538765:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788651821.538772:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147547264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.538809:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147547264:12345-0@lo:400:kworker.0 Request processed in 37us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651821.538816:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1788651821.538847:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147548928 00000100:00100000:2.0:1788651821.538850:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147548928 00000100:00100000:2.0:1788651821.538863:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147549056 00000100:00100000:2.0:1788651821.538867:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147549056 00000100:00100000:2.0:1788651821.538877:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788651821.538882:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147548928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651821.538902:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651821.538953:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147548928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651821.538959:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788651821.538973:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788651821.538979:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147549056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651821.538989:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651821.539210:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147549056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 228us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651821.539216:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788651821.539248:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147547392:0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.539258:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2833480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147547904:0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.539267:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147548416:0@lo:400:kworker.0 00010000:00080000:2.0:1788651821.539289:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3588380 x1875537147548928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651821.539381:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3588380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147548928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651821.539394:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147547264:0@lo:400:kworker.0 00000100:00100000:2.0:1788651821.539405:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147547776:0@lo:400:kworker.0 00010000:00080000:2.0:1788651821.539416:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34ad880 x1875537147548288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651821.539423:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147548288:0@lo:400:kworker.0 00010000:00080000:2.0:1788651821.539432:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c358b100 x1875537147548800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651837 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651821.539441:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c358b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147548800:0@lo:400:kworker.0 00010000:00080000:0.0:1788651821.541561:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb12d80 x1875537147549056/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651837 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651821.541586:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147549056:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651822.560171:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651822.560197:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147549184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651822.560264:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651822.560575:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147549184 00000100:00100000:2.0:1788651822.560583:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147549184 00000100:00100000:2.0:1788651822.560630:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788651822.560639:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147549184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651822.560669:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651822.560722:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147549184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651822.560728:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788651822.560806:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5b800 x1875537147549184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651822.560835:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147549184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651822.561116:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651822.561127:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147549312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651822.561161:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651822.561275:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651822.561325:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147549312 00000100:00100000:0.0:1788651822.561330:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147549312 00000100:00100000:0.0:1788651822.561368:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788651822.561375:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147549312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788651822.561389:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651822.561431:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147549312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651822.561438:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1788651822.561627:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb12d80 x1875537147549312/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651822.561640:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147549312:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651823.270605:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651823.270653:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651823.270688:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651823.270790:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125452160 00000100:00100000:0.0:1788651823.270801:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125452160 00000100:00100000:3.0:1788651823.270935:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125452288 00000100:00100000:3.0:1788651823.270939:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125452288 00000100:00100000:3.0:1788651823.270989:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125452416 00000100:00100000:3.0:1788651823.270992:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125452416 00000100:00100000:3.0:1788651823.271023:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 130 00000100:00100000:3.0:1788651823.271032:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125452288:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651823.271102:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125452288:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 70us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651823.271126:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 130 00000100:00100000:0.0:1788651823.271139:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 291 00000100:00100000:3.0:1788651823.271141:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 131 00000100:00100000:3.0:1788651823.271147:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125452416:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651823.271147:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2389:x1875537125452160:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651823.271176:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2389:x1875537125452160:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 30us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651823.271182:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 291 00000100:00100000:3.0:1788651823.271183:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125452416:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 36us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651823.271188:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 131 00000100:00080000:1.0:1788651823.271588:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788651823.271592:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651823.584124:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147549440:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788651823.584208:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651823.584313:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147549440 00000100:00100000:0.0:1788651823.584321:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147549440 00000100:00100000:0.0:1788651823.584380:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788651823.584389:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147549440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788651823.584428:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00010000:00010000:3.0:1788651823.584590:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651823.585750:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147549440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1356us (1536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651823.585762:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788651823.592889:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147549440:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788651824.537149:0:11986:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 19:43:42 (1788651822) === 00010000:00010000:3.0:1788651824.610313:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651824.910324:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651824.911144:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125452544 00000100:00100000:0.0:1788651824.911168:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125452544 00000100:00100000:0.0:1788651824.911240:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 292 00000100:00100000:0.0:1788651824.911251:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:8732:x1875537125452544:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788651824.911267:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651824.911286:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3cfd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33b3f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651824.911317:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b3f expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651824.911329:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3cfd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b3f expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651824.911338:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4200, rc 0) 00000100:00100000:0.0:1788651824.911406:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8732:x1875537125452544:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 157us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651824.911415:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 292 00000100:00100000:2.0:1788651824.915529:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651824.917024:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125452672 00000100:00100000:0.0:1788651824.917037:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125452672 00000100:00100000:0.0:1788651824.917108:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 293 00000100:00100000:0.0:1788651824.917120:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8732:x1875537125452672:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788651824.917297:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8732:x1875537125452672:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 179us (1777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651824.917306:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 293 00000100:00100000:1.0:1788651824.921364:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651824.921473:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125452800 00000100:00100000:2.0:1788651824.921483:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125452800 00000100:00100000:2.0:1788651824.921544:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 294 00000100:00100000:2.0:1788651824.921554:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8732:x1875537125452800:12345-192.168.204.45@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788651824.921716:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8732:x1875537125452800:12345-192.168.204.45@tcp:503:mount.lustre.0 Request processed in 163us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651824.921725:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 294 00000100:00100000:3.0:1788651824.927264:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651824.927473:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125452928 00000100:00100000:1.0:1788651824.927483:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125452928 00000100:00100000:1.0:1788651824.927541:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 295 00000100:00100000:1.0:1788651824.927551:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8736:x1875537125452928:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788651824.927713:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8736:x1875537125452928:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 163us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651824.927722:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 295 00000100:00100000:3.0:1788651824.966845:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651824.967008:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125453056 00000100:00100000:0.0:1788651824.967019:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125453056 00000100:00100000:0.0:1788651824.967084:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 296 00000100:00100000:0.0:1788651824.967095:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8736:x1875537125453056:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788651824.967269:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8736:x1875537125453056:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 175us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651824.967278:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 296 00000100:00100000:3.0:1788651824.976349:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651824.976445:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125453184 00000100:00100000:2.0:1788651824.976456:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125453184 00000100:00100000:2.0:1788651824.976526:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 297 00000100:00100000:2.0:1788651824.976535:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8736:x1875537125453184:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788651824.976684:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8736:x1875537125453184:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 150us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651824.976692:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 297 00000100:00100000:3.0:1788651824.981195:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651824.984412:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125453312 00000100:00100000:1.0:1788651824.984429:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125453312 00000100:00100000:1.0:1788651824.984512:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 298 00000100:00100000:1.0:1788651824.984541:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:8732:x1875537125453312:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788651824.984559:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651824.984579:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c3d04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33b70 expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651824.984611:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c3d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b70 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651824.984624:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c3d04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b70 expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651824.984633:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414400, rc 0) 00000100:00100000:1.0:1788651824.984762:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:8732:x1875537125453312:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 223us (3576us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651824.984770:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 298 00000100:00100000:3.0:1788651824.992079:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651824.992240:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125453440 00000100:00100000:0.0:1788651824.992250:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125453440 00000100:00100000:0.0:1788651824.992315:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 299 00000100:00100000:0.0:1788651824.992327:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:8732:x1875537125453440:12345-192.168.204.45@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788651824.992352:0:6504:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788651824.992376:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788651824.992379:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788651824.992383:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788651824.992386:0:6504:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788651824.992388:0:6504:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1788651824.998444:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:8732:x1875537125453440:12345-192.168.204.45@tcp:256:mount.lustre.0 Request processed in 6107us (6364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651824.998458:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 299 00000100:00100000:3.0:1788651825.002674:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651825.003220:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125453568 00000100:00100000:2.0:1788651825.003232:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125453568 00000100:00100000:2.0:1788651825.003399:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 300 00000100:00100000:2.0:1788651825.003409:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:8732:x1875537125453568:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788651825.003428:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651825.003448:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3d0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33b77 expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651825.003488:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b77 expref: 13 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651825.003520:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b77 expref: 13 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651825.003531:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd200, rc 0) 00000100:00100000:2.0:1788651825.003594:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:8732:x1875537125453568:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 187us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651825.003602:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 300 00000100:00100000:3.0:1788651825.007544:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651825.009151:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125453696 00000100:00100000:1.0:1788651825.009165:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125453696 00000100:00100000:1.0:1788651825.009217:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 301 00000100:00100000:1.0:1788651825.009226:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:8732:x1875537125453696:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788651825.009398:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:8732:x1875537125453696:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 172us (1863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651825.009405:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 301 00000100:00100000:3.0:1788651825.011321:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651825.011397:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125453824 00000100:00100000:1.0:1788651825.011406:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125453824 00000100:00100000:1.0:1788651825.011456:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 302 00000100:00100000:1.0:1788651825.011474:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:8732:x1875537125453824:12345-192.168.204.45@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788651825.011621:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:8732:x1875537125453824:12345-192.168.204.45@tcp:503:mount.lustre.0 Request processed in 148us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651825.011634:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 302 00000100:00100000:3.0:1788651825.019449:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651825.019563:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125453952 00000100:00100000:1.0:1788651825.019573:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125453952 00000100:00100000:1.0:1788651825.019629:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 303 00000100:00100000:1.0:1788651825.019639:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:8739:x1875537125453952:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788651825.019795:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:8739:x1875537125453952:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 156us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651825.019812:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 303 00000100:00100000:3.0:1788651825.022588:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651825.022874:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125454080 00000100:00100000:0.0:1788651825.022885:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125454080 00000100:00100000:0.0:1788651825.023144:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 304 00000100:00100000:0.0:1788651825.023157:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:8739:x1875537125454080:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788651825.023322:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:8739:x1875537125454080:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 167us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651825.023330:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 304 00000100:00100000:3.0:1788651825.031199:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651825.031239:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651825.031270:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651825.031313:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651825.031349:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125454208 00000100:00100000:1.0:1788651825.031360:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125454208 00000100:00100000:1.0:1788651825.031390:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125454464 00000100:00100000:1.0:1788651825.031393:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125454464 00000100:00100000:1.0:1788651825.031401:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125454848 00000100:00100000:1.0:1788651825.031403:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125454848 00000100:00100000:1.0:1788651825.031442:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125454976 00000100:00100000:1.0:1788651825.031445:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125454976 00000100:00100000:1.0:1788651825.031474:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 132 00000100:00100000:1.0:1788651825.031484:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125454848:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651825.031504:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:2.0:1788651825.031511:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2387:x1875537125454208:12345-192.168.204.45@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788651825.031535:0:6509:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 029f4676-f465-4d1e-a0cb-3243b2e8fb58@192.168.204.45@tcp t0 exp 0000000000000000 cur 280 last 0 00000100:00100000:1.0:1788651825.031559:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125454848:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651825.031567:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 132 00000020:00000080:2.0:1788651825.031572:0:6509:0:(genops.c:1385:class_connect()) connect: client 029f4676-f465-4d1e-a0cb-3243b2e8fb58, cookie 0xcd2f56ea038c3d12 00000100:00100000:1.0:1788651825.031582:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 133 00000100:00100000:1.0:1788651825.031588:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125454976:12345-192.168.204.45@tcp:400:kworker.0 00000004:00100000:2.0:1788651825.031597:0:6509:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788651825.031610:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125454976:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 23us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651825.031632:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 133 00000100:00100000:1.0:1788651825.031644:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:1.0:1788651825.031648:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2387:x1875537125454464:12345-192.168.204.45@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788651825.031664:0:6510:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 029f4676-f465-4d1e-a0cb-3243b2e8fb58@192.168.204.45@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:1.0:1788651825.031686:0:6510:0:(genops.c:1385:class_connect()) connect: client 029f4676-f465-4d1e-a0cb-3243b2e8fb58, cookie 0xcd2f56ea038c3d19 00000004:00100000:1.0:1788651825.031698:0:6510:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788651825.031748:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651825.031752:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651825.031805:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8f85c3182000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788651825.031841:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2387:x1875537125454464:12345-192.168.204.45@tcp:38:mount.lustre.0 Request processed in 191us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651825.031849:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00080000:2.0:1788651825.031904:0:6509:0:(import.c:65:import_set_state_nolock()) ffff8f85c354d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788651825.031951:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2387:x1875537125454208:12345-192.168.204.45@tcp:38:mount.lustre.0 Request processed in 439us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651825.031958:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:3.0:1788651825.036609:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651825.036667:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651825.036713:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651825.036810:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125454592 00000100:00100000:2.0:1788651825.036821:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125454592 00000100:00100000:2.0:1788651825.036885:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125454336 00000100:00100000:2.0:1788651825.036889:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125454336 00000100:00100000:2.0:1788651825.036901:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125454720 00000100:00100000:2.0:1788651825.036903:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125454720 00000100:00100000:2.0:1788651825.036949:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:2.0:1788651825.036959:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:0:x1875537125454592:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788651825.037006:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651825.037062:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:1.0:1788651825.037070:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+7:0:x1875537125454336:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788651825.037089:0:6510:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788651825.037092:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:0:x1875537125454592:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 134us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651825.037098:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:2.0:1788651825.037115:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:2.0:1788651825.037121:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+7:8732:x1875537125454720:12345-192.168.204.45@tcp:41:mount.lustre.0 00000100:00100000:1.0:1788651825.037124:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+7:0:x1875537125454336:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 56us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651825.037130:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00000004:00000024:2.0:1788651825.037131:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788651825.037151:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:8732:x1875537125454720:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 31us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651825.037157:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00080000:3.0:1788651825.037493:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651825.037498:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651825.041106:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651825.041206:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125455104 00000100:00100000:1.0:1788651825.041218:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125455104 00000100:00100000:1.0:1788651825.041278:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:1.0:1788651825.041288:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:8732:x1875537125455104:12345-192.168.204.45@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788651825.041378:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:8732:x1875537125455104:12345-192.168.204.45@tcp:40:mount.lustre.0 Request processed in 90us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651825.041385:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:0.0:1788651825.056519:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651825.056620:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125455232 00000100:00100000:2.0:1788651825.056631:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125455232 00000100:00100000:2.0:1788651825.056695:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:2.0:1788651825.056703:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1875537125455232:12345-192.168.204.45@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788651825.056738:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 029f4676-f465-4d1e-a0cb-3243b2e8fb58@192.168.204.45@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:2.0:1788651825.056777:0:8428:0:(genops.c:1385:class_connect()) connect: client 029f4676-f465-4d1e-a0cb-3243b2e8fb58, cookie 0xcd2f56ea038c3d20 00002000:00100000:2.0:1788651825.056789:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 029f4676-f465-4d1e-a0cb-3243b2e8fb58/ffff8f85c354f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788651825.056808:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788651825.056893:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788651825.056959:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8f85c354b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788651825.057029:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2387:x1875537125455232:12345-192.168.204.45@tcp:8:mount.lustre.0 Request processed in 325us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651825.057037:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:3.0:1788651825.062251:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651825.062301:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651825.062396:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125455360 00000100:00100000:1.0:1788651825.062411:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125455360 00000100:00100000:1.0:1788651825.062476:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:1.0:1788651825.062484:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2387:x1875537125455360:12345-192.168.204.45@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788651825.062525:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 029f4676-f465-4d1e-a0cb-3243b2e8fb58@192.168.204.45@tcp t0 exp 0000000000000000 cur 280 last 0 00000020:00000080:1.0:1788651825.062563:0:8429:0:(genops.c:1385:class_connect()) connect: client 029f4676-f465-4d1e-a0cb-3243b2e8fb58, cookie 0xcd2f56ea038c3d27 00002000:00100000:1.0:1788651825.062578:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 029f4676-f465-4d1e-a0cb-3243b2e8fb58/ffff8f85c3187000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788651825.062600:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788651825.062818:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1788651825.062964:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125455488 00000100:00100000:2.0:1788651825.062970:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125455488 00000100:00100000:2.0:1788651825.063021:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:2.0:1788651825.063046:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:8732:x1875537125455488:12345-192.168.204.45@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788651825.063131:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:8732:x1875537125455488:12345-192.168.204.45@tcp:900:mount.lustre.0 Request processed in 86us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651825.063140:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00080000:1.0:1788651825.063398:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f85c3181000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788651825.063535:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2387:x1875537125455360:12345-192.168.204.45@tcp:8:mount.lustre.0 Request processed in 1050us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651825.063543:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:3.0:1788651825.068988:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651825.069571:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125455616 00000100:00100000:2.0:1788651825.069581:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125455616 00000100:00100000:2.0:1788651825.069641:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:2.0:1788651825.069651:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:8732:x1875537125455616:12345-192.168.204.45@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788651825.069742:0:6512:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788651825.069844:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:8732:x1875537125455616:12345-192.168.204.45@tcp:33:mount.lustre.0 Request processed in 193us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651825.069851:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:1.0:1788651825.120611:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147549568:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788651825.120694:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651825.121170:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147549568 00000100:00100000:2.0:1788651825.121180:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147549568 00000100:00100000:2.0:1788651825.121239:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788651825.121251:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147549568:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788651825.121286:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788651825.121353:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147549568:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651825.121361:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788651825.121525:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147549568:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788651825.633069:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651826.656256:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147549696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651826.656351:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651826.656441:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147549696 00000100:00100000:2.0:1788651826.656449:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147549696 00000100:00100000:2.0:1788651826.656501:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788651826.656511:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147549696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651826.656558:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651826.656604:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147549696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651826.656611:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:2.0:1788651826.656653:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5b800 x1875537147549696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651826.656672:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147549696:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788651826.658887:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788651826.659079:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651826.661100:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147549824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651826.661186:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651826.664404:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651826.664421:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147549952:0@lo:400:kworker.0 00000100:00100000:2.0:1788651826.664507:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651826.664668:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147549952 00000100:00100000:1.0:1788651826.664677:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147549952 00000100:00100000:1.0:1788651826.664727:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788651826.664738:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147549952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651826.664789:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147549952:12345-0@lo:400:kworker.0 Request processed in 52us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651826.664796:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788651826.665004:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147549952:0@lo:400:kworker.0 00000100:00100000:2.0:1788651826.665049:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147549824 00000100:00100000:2.0:1788651826.665053:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147549824 00000100:00100000:2.0:1788651826.665127:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788651826.665134:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147549824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651826.665155:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651826.665198:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147549824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (4012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651826.665204:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788651826.665237:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb11500 x1875537147549824/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651842 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651826.665254:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147549824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788651826.666805:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147550080:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.666870:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651826.666899:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147550592:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.666945:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651826.666963:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147551104:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.666983:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651826.667005:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788651826.667011:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147550208:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.667034:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651826.667051:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147550720:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.667071:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651826.667088:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147551232:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.667108:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651826.667128:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147550464:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.667149:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651826.667167:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147550976:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.667188:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651826.667207:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788651826.667212:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147550336:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.667231:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651826.667241:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147550848:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.667259:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651826.667287:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147550080 00000100:00100000:0.0:1788651826.667293:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147550080 00000100:00100000:0.0:1788651826.668004:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147550592 00000100:00100000:0.0:1788651826.668010:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147550592 00000100:00080000:1.0:1788651826.668218:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651826.668224:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651826.669298:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147550208 00000100:00100000:2.0:1788651826.669317:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147550208 00000100:00100000:2.0:1788651826.669364:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147550464 00000100:00100000:2.0:1788651826.669367:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147550464 00000100:00100000:2.0:1788651826.669385:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788651826.669394:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147550208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651826.669488:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147550208:12345-0@lo:400:kworker.0 Request processed in 95us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651826.669496:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788651826.669510:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788651826.669515:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147550464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651826.669666:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147550464:12345-0@lo:400:kworker.0 Request processed in 150us (2515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651826.669672:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788651826.669693:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147551104 00000100:00100000:2.0:1788651826.669697:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147551104 00000100:00100000:2.0:1788651826.669723:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147550720 00000100:00100000:2.0:1788651826.669726:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147550720 00000100:00100000:2.0:1788651826.669738:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147551232 00000100:00100000:2.0:1788651826.669741:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147551232 00000100:00100000:2.0:1788651826.669750:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147550336 00000100:00100000:2.0:1788651826.669752:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147550336 00000100:00100000:2.0:1788651826.669762:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788651826.669768:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147550080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651826.669801:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147550080:12345-0@lo:400:kworker.0 Request processed in 33us (2932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651826.669807:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788651826.669821:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788651826.669834:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147551104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651826.669860:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147551104:12345-0@lo:400:kworker.0 Request processed in 27us (2877us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651826.669866:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788651826.669878:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788651826.669883:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147550720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651826.669924:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147550720:12345-0@lo:400:kworker.0 Request processed in 24us (2835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651826.669931:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788651826.669942:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788651826.669948:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147551232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651826.669976:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147551232:12345-0@lo:400:kworker.0 Request processed in 29us (2867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651826.669982:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788651826.669993:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788651826.669999:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147550336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651826.670023:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147550336:12345-0@lo:400:kworker.0 Request processed in 25us (2791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651826.670029:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1788651826.670248:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788651826.670252:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651826.670996:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147550976 00000100:00100000:1.0:1788651826.671004:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147550976 00000100:00100000:1.0:1788651826.671049:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147550848 00000100:00100000:1.0:1788651826.671052:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147550848 00000100:00100000:1.0:1788651826.671074:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788651826.671083:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147550976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651826.671131:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147550976:12345-0@lo:400:kworker.0 Request processed in 51us (3943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651826.671138:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788651826.671151:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788651826.671157:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147550848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651826.671181:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147550848:12345-0@lo:400:kworker.0 Request processed in 25us (3921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651826.671187:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1788651826.671399:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651826.672646:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788651826.672657:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147550592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.672718:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147550592:12345-0@lo:400:kworker.0 Request processed in 64us (5771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651826.672725:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788651826.672776:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147550336:0@lo:400:kworker.0 00010000:00080000:0.0:1788651826.672792:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34b1500 x1875537147550848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651826.672803:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147550848:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.672813:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147550464:0@lo:400:kworker.0 00010000:00080000:0.0:1788651826.672823:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34b3800 x1875537147550976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651826.672832:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147550976:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.672872:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147550208:0@lo:400:kworker.0 00010000:00080000:0.0:1788651826.672885:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb10e00 x1875537147550720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651826.672894:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147550720:0@lo:400:kworker.0 00010000:00080000:0.0:1788651826.672904:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34b2680 x1875537147551232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651842 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651826.672939:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147551232:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.672952:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147550080:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.672962:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147550592:0@lo:400:kworker.0 00000100:00100000:0.0:1788651826.672991:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147551104:0@lo:400:kworker.0 00010000:00010000:3.0:1788651827.683433:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651827.688643:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651827.688666:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147551360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651827.688740:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651827.688839:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147551360 00000100:00100000:3.0:1788651827.688846:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147551360 00000100:00100000:3.0:1788651827.688896:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788651827.688952:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147551360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651827.688983:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651827.689043:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147551360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651827.689051:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:3.0:1788651827.689091:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ea15dc00 x1875537147551360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651827.689110:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147551360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651827.691058:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651827.691079:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147551488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651827.691139:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651827.691198:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147551488 00000100:00100000:2.0:1788651827.691304:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147551488 00000100:00100000:2.0:1788651827.691348:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788651827.691357:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147551488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788651827.691386:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651827.691447:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147551488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651827.691454:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1788651827.691510:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c2680 x1875537147551488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651827.691529:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147551488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651828.704223:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651828.704257:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147551616:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788651828.704334:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651828.704500:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147551616 00000100:00100000:3.0:1788651828.704509:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147551616 00000100:00100000:3.0:1788651828.704558:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788651828.704568:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147551616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651828.704602:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651828.704796:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147551616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 229us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651828.704804:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788651828.704962:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147551616:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788651828.705367:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651829.729310:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651830.241172:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651830.241213:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147551744:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651830.241286:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651830.241507:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147551744 00000100:00100000:1.0:1788651830.241515:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147551744 00000100:00100000:1.0:1788651830.241567:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788651830.241575:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147551744:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651830.241608:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788651830.241663:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147551744:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651830.241670:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788651830.241795:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147551744:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651830.458051:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651830.458089:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651830.458112:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651830.458132:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651830.458149:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651830.458168:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651830.458211:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651830.458246:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125456000 00000100:00100000:2.0:1788651830.458255:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125456000 00000100:00100000:2.0:1788651830.458304:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125456256 00000100:00100000:2.0:1788651830.458307:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125456256 00000100:00100000:2.0:1788651830.458320:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125455872 00000100:00100000:2.0:1788651830.458323:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125455872 00000100:00100000:2.0:1788651830.458335:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125456128 00000100:00100000:2.0:1788651830.458337:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125456128 00000100:00100000:2.0:1788651830.458385:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 140 00000100:00100000:2.0:1788651830.458396:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125456000:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651830.458474:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125456000:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 80us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651830.458482:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 140 00000100:00100000:2.0:1788651830.458498:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 141 00000100:00100000:2.0:1788651830.458505:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125456256:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651830.458528:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125456256:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 24us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651830.458534:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 141 00000100:00100000:2.0:1788651830.458544:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 142 00000100:00100000:2.0:1788651830.458550:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125455872:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651830.458573:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125455872:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 22us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651830.458579:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 142 00000100:00100000:2.0:1788651830.458589:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 143 00000100:00100000:2.0:1788651830.458596:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125456128:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651830.458617:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125456128:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 22us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651830.458622:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 143 00000100:00100000:1.0:1788651830.458818:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125456512 00000100:00100000:1.0:1788651830.458823:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125456512 00000100:00100000:1.0:1788651830.458851:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125456384 00000100:00100000:1.0:1788651830.458854:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125456384 00000100:00100000:1.0:1788651830.458872:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:1.0:1788651830.458879:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125456512:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651830.458934:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125456512:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 56us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651830.458940:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:1.0:1788651830.458952:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:1.0:1788651830.458957:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125456384:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651830.458976:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125456384:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 20us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651830.458981:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00080000:1.0:1788651830.458996:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651830.459000:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651830.459002:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651830.459004:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788651830.459165:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125455744 00000100:00100000:0.0:1788651830.459171:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125455744 00000100:00100000:0.0:1788651830.459199:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 306 00000100:00100000:0.0:1788651830.459206:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125455744:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651830.459234:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125455744:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 29us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651830.459239:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 306 00010000:00010000:3.0:1788651830.757062:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788651831.080667:0:12179:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:2.0:1788651831.275322:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000001:00100000:3.0:1788651831.277610:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000001:00100000:2.0:1788651831.281240:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000001:00100000:1.0:1788651831.281514:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000100:00100000:2.0:1788651831.776060:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651831.776082:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147551872:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651831.776160:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651831.776468:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147551872 00000100:00100000:2.0:1788651831.776476:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147551872 00000100:00100000:2.0:1788651831.776522:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788651831.776531:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147551872:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651831.776559:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651831.776594:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147551872:12345-0@lo:13:osp-pre-1-1.0 Request processed in 64us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651831.776601:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788651831.776621:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147552256:0@lo:400:kworker.0 00000100:00100000:2.0:1788651831.776644:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651831.776658:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147552768:0@lo:400:kworker.0 00000100:00100000:2.0:1788651831.776746:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651831.776763:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147553280:0@lo:400:kworker.0 00000100:00100000:2.0:1788651831.776779:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651831.776793:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788651831.776798:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147552128:0@lo:400:kworker.0 00000100:00100000:2.0:1788651831.776813:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651831.776823:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147552640:0@lo:400:kworker.0 00000100:00100000:2.0:1788651831.776837:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651831.776849:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147553152:0@lo:400:kworker.0 00000100:00100000:2.0:1788651831.776863:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788651831.776877:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651831.776890:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147552768 00000100:00100000:2.0:1788651831.776893:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147552768 00000100:00100000:2.0:1788651831.776934:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147553280 00000100:00100000:2.0:1788651831.776942:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147553280 00000100:00100000:2.0:1788651831.776955:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147552128 00000100:00100000:2.0:1788651831.776957:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147552128 00000100:00100000:2.0:1788651831.776965:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147552640 00000100:00100000:2.0:1788651831.776967:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147552640 00000100:00100000:2.0:1788651831.776976:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147553152 00000100:00100000:2.0:1788651831.776978:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147553152 00000100:00100000:2.0:1788651831.776990:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788651831.776995:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147552768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.777173:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147552384:0@lo:400:kworker.0 00000100:00100000:1.0:1788651831.777267:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788651831.777277:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147553280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.780652:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651831.780708:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147552896:0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.780748:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651831.780769:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147553408:0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.780790:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651831.780828:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:3.0:1788651831.780835:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147552000:0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.780865:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651831.780902:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147552512:0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.780945:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651831.780967:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147553024:0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.780990:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651831.781009:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147553536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651831.781045:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651831.781084:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651831.781105:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147552256 00000100:00100000:3.0:1788651831.781114:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147552256 00000100:00100000:3.0:1788651831.781170:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147552512 00000100:00100000:3.0:1788651831.781173:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147552512 00000100:00100000:3.0:1788651831.781190:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788651831.781211:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147552256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.781273:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147552256:12345-0@lo:400:kworker.0 Request processed in 74us (4626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651831.781282:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788651831.781300:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788651831.781306:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147552512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.781354:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147552512:12345-0@lo:400:kworker.0 Request processed in 48us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651831.781360:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788651831.781379:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147552896 00000100:00100000:3.0:1788651831.781383:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147552896 00000100:00100000:3.0:1788651831.781413:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147553408 00000100:00100000:3.0:1788651831.781417:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147553408 00000100:00100000:3.0:1788651831.781431:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147553024 00000100:00100000:3.0:1788651831.781433:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147553024 00000100:00100000:3.0:1788651831.781448:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788651831.781463:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147552896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.781494:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147552896:12345-0@lo:400:kworker.0 Request processed in 33us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651831.781500:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788651831.781512:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788651831.781517:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147553408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.781544:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147553408:12345-0@lo:400:kworker.0 Request processed in 27us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651831.781551:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788651831.781560:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788651831.781566:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147553024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.781591:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147553024:12345-0@lo:400:kworker.0 Request processed in 25us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651831.781596:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788651831.781617:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147552000 00000100:00100000:3.0:1788651831.781621:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147552000 00000100:00100000:3.0:1788651831.781646:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788651831.781652:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147552000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.781681:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147552000:12345-0@lo:400:kworker.0 Request processed in 30us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651831.781687:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788651831.781749:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147553536 00000100:00100000:3.0:1788651831.781753:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147553536 00000100:00100000:3.0:1788651831.781776:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788651831.781782:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147553536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651831.781796:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651831.781835:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147553536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651831.781841:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788651831.781882:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147552256:0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.781935:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147552000:0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.781945:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147552512:0@lo:400:kworker.0 00010000:00080000:3.0:1788651831.781956:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff460e00 x1875537147553024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651831.781966:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147553024:0@lo:400:kworker.0 00010000:00080000:3.0:1788651831.781975:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb52680 x1875537147553536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651831.781987:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147553536:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788651831.781996:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff462a00 x1875537147552896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651831.782003:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147552896:0@lo:400:kworker.0 00010000:00080000:3.0:1788651831.782009:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff463800 x1875537147553408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651831.782015:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147553408:0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.782073:0:10110:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788651831.782081:0:10110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788651831.782092:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788651831.782098:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147552384 00000100:00100000:3.0:1788651831.782101:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147552384 00000100:00100000:3.0:1788651831.782122:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788651831.782128:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788651831.782133:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147552128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.782166:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147552128:12345-0@lo:400:kworker.0 Request processed in 33us (5353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651831.782173:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788651831.782182:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788651831.782187:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788651831.782192:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147552640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.782221:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147552640:12345-0@lo:400:kworker.0 Request processed in 29us (5383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651831.782226:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788651831.782235:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788651831.782240:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788651831.782247:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147553152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.782271:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147553152:12345-0@lo:400:kworker.0 Request processed in 24us (5407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651831.782276:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788651831.782284:0:6510:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788651831.782289:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788651831.782294:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147552384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.782325:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147552384:12345-0@lo:400:kworker.0 Request processed in 31us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651831.782342:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00010000:00080000:3.0:1788651831.782449:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c0380 x1875537147551872/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651847 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651831.782475:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147551872:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651831.782507:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147552128:0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.782517:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147552640:0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.782527:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147553152:0@lo:400:kworker.0 00000100:00100000:3.0:1788651831.782549:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147552384:0@lo:400:kworker.0 00000100:00080000:3.0:1788651831.782708:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651831.782713:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651831.782715:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651831.782718:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651831.785872:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147553280:12345-0@lo:400:kworker.0 Request processed in 8588us (9081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651831.785886:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00080000:3.0:1788651831.786429:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff461500 x1875537147553280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651831.786446:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147553280:0@lo:400:kworker.0 00000100:00100000:2.0:1788651831.786597:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147552768:12345-0@lo:400:kworker.0 Request processed in 9600us (9849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651831.786606:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00010000:00080000:3.0:1788651831.786758:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5b800 x1875537147552768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651847 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651831.786767:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147552768:0@lo:400:kworker.0 00000100:00100000:1.0:1788651832.800226:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651832.800252:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147553664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651832.800338:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651832.800540:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147553792:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651832.800569:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651832.800763:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147553664 00000100:00100000:1.0:1788651832.800772:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147553664 00000100:00100000:1.0:1788651832.800811:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147553792 00000100:00100000:1.0:1788651832.800814:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147553792 00000100:00100000:1.0:1788651832.800830:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788651832.800854:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147553664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651832.800886:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651832.800962:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147553664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651832.800969:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788651832.800985:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788651832.800991:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147553792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651832.801001:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651832.801024:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147553792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651832.801030:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1788651832.801646:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb52680 x1875537147553792/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651832.801681:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147553792:0@lo:13:osp-pre-0-1.0 00010000:00080000:2.0:1788651832.801703:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff446a00 x1875537147553664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651832.801715:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147553664:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788651832.802208:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651833.826943:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147553920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651833.827042:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651833.827141:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651833.827165:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147553920 00000100:00100000:3.0:1788651833.827174:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147553920 00000100:00100000:3.0:1788651833.827221:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788651833.827230:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147553920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651833.827284:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651833.827340:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147553920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651833.827348:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788651833.827408:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147553920:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788651834.853042:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651835.360574:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147554048:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651835.360667:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651835.361027:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147554048 00000100:00100000:2.0:1788651835.361035:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147554048 00000100:00100000:2.0:1788651835.361089:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788651835.361099:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147554048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788651835.361134:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788651835.361186:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147554048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651835.361208:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788651835.361428:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147554048:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788651835.561963:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651835.562027:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125456640 00000100:00100000:2.0:1788651835.562039:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125456640 00000100:00100000:2.0:1788651835.562174:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 308 00000100:00100000:2.0:1788651835.562186:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125456640:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651835.562271:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125456640:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 75us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651835.562519:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 308 00000100:00100000:1.0:1788651835.562569:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651835.562791:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125456896 00000100:00100000:1.0:1788651835.562796:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125456896 00000100:00100000:1.0:1788651835.563116:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 150 00000100:00100000:1.0:1788651835.563125:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125456896:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651835.563175:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125456896:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 51us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651835.563182:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 150 00000100:00100000:2.0:1788651835.564036:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651835.564103:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125457152 00000100:00100000:1.0:1788651835.564112:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125457152 00000100:00100000:2.0:1788651835.564141:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651835.564171:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651835.564190:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651835.564209:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651835.564234:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125457408 00000100:00100000:2.0:1788651835.564238:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125457408 00000100:00100000:2.0:1788651835.570054:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125457280 00000100:00100000:2.0:1788651835.570189:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125457280 00000100:00100000:2.0:1788651835.570244:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:2.0:1788651835.570268:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125457408:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651835.570428:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125457408:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 173us (6286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651835.570437:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:1.0:1788651835.570489:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125456768 00000100:00100000:1.0:1788651835.570496:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125456768 00000100:00100000:1.0:1788651835.570521:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125457024 00000100:00100000:1.0:1788651835.570524:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125457024 00000100:00100000:1.0:1788651835.570561:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 151 00000100:00100000:1.0:1788651835.570570:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125457152:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651835.570654:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:2.0:1788651835.570665:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125457280:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651835.570727:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125457152:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 157us (6694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651835.570734:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 151 00000100:00100000:1.0:1788651835.570747:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 152 00000100:00100000:1.0:1788651835.570753:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125456768:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651835.571698:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 153 00000100:00100000:3.0:1788651835.571711:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125457024:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651835.574391:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125457280:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 3714us (10166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651835.574425:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:1.0:1788651835.574563:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125456768:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 3806us (10387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651835.574573:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 152 00000100:00080000:0.0:1788651835.579199:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651835.579961:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788651835.579966:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651835.579970:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651835.581718:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125457024:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 10003us (17518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651835.582043:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 153 00010000:00010000:1.0:1788651835.872226:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651836.896352:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651836.896375:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147554176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651836.896453:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.896851:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147554560:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.896882:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.896903:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147555072:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.896945:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.896960:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147555584:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.896979:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.897006:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788651836.897026:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147554432:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897065:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.897088:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147554944:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897110:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.897128:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147555456:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897150:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.897178:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147554560 00000100:00100000:3.0:1788651836.897184:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147554560 00000100:00100000:3.0:1788651836.897243:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147555072 00000100:00100000:3.0:1788651836.897247:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147555072 00000100:00100000:3.0:1788651836.897274:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147555584 00000100:00100000:3.0:1788651836.897277:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147555584 00000100:00100000:3.0:1788651836.897295:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788651836.897302:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147554560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897351:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147554560:12345-0@lo:400:kworker.0 Request processed in 49us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.897357:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788651836.897372:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788651836.897378:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147555072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897405:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3661f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147555072:12345-0@lo:400:kworker.0 Request processed in 27us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.897412:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788651836.897422:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788651836.897428:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147555584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897452:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3661500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147555584:12345-0@lo:400:kworker.0 Request processed in 25us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.897466:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788651836.897487:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147554432 00000100:00100000:3.0:1788651836.897490:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147554432 00000100:00100000:3.0:1788651836.897517:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788651836.897523:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147554432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897568:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147554432:12345-0@lo:400:kworker.0 Request processed in 45us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.897575:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788651836.897602:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147554944 00000100:00100000:3.0:1788651836.897606:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147554944 00000100:00100000:3.0:1788651836.897632:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788651836.897639:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147554944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897672:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3661c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147554944:12345-0@lo:400:kworker.0 Request processed in 33us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.897678:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788651836.897695:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147555456 00000100:00100000:3.0:1788651836.897699:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147555456 00000100:00100000:3.0:1788651836.897727:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788651836.897734:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147555456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897763:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147555456:12345-0@lo:400:kworker.0 Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.897769:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788651836.897785:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651836.897790:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651836.897815:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147554304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651836.897843:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.897872:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147554816:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897895:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.897933:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147555328:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897952:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.897968:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147555840:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.897983:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.898000:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788651836.898006:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147554688:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.898023:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.898037:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147555200:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.898053:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.898066:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147555712:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.898086:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651836.898111:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147554176 00000100:00100000:3.0:1788651836.898114:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147554176 00000100:00100000:3.0:1788651836.898137:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147554304 00000100:00100000:3.0:1788651836.898141:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147554304 00000100:00100000:3.0:1788651836.898152:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788651836.898157:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f58ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147554176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651836.898178:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651836.898212:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f58ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147554176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (1759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.898218:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788651836.898401:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788651836.898408:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147554304:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788651836.898418:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651836.898457:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147554304:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.898463:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788651836.898481:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147555328 00000100:00100000:3.0:1788651836.898492:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147555328 00000100:00100000:3.0:1788651836.898517:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147555840 00000100:00100000:3.0:1788651836.898521:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147555840 00000100:00100000:3.0:1788651836.898538:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788651836.898544:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147555328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.898574:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147555328:12345-0@lo:400:kworker.0 Request processed in 31us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.898580:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788651836.898591:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788651836.898597:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147555840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.898622:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147555840:12345-0@lo:400:kworker.0 Request processed in 26us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.898628:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788651836.898647:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147554688 00000100:00100000:3.0:1788651836.898651:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147554688 00000100:00100000:3.0:1788651836.898672:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788651836.898678:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147554688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.898707:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147554688:12345-0@lo:400:kworker.0 Request processed in 29us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.898714:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788651836.898733:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147554816 00000100:00100000:3.0:1788651836.898736:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147554816 00000100:00100000:3.0:1788651836.898751:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147555200 00000100:00100000:3.0:1788651836.898754:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147555200 00000100:00100000:3.0:1788651836.898779:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147555712 00000100:00100000:3.0:1788651836.898782:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147555712 00000100:00100000:3.0:1788651836.898793:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788651836.898798:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147554816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.898828:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147554816:12345-0@lo:400:kworker.0 Request processed in 29us (932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.898833:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788651836.898844:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788651836.898850:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147555200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.898874:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147555200:12345-0@lo:400:kworker.0 Request processed in 24us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.898879:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788651836.898889:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788651836.898895:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147555712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.898946:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147555712:12345-0@lo:400:kworker.0 Request processed in 51us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651836.898952:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:3.0:1788651836.898968:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651836.898972:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651836.898974:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651836.899006:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147554432:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.899019:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147554944:0@lo:400:kworker.0 00010000:00080000:3.0:1788651836.899030:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c0380 x1875537147555456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651836.899040:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147555456:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.899063:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147554560:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.899074:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147555072:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.899084:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147555584:0@lo:400:kworker.0 00000100:00100000:3.0:1788651836.899117:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147554688:0@lo:400:kworker.0 00010000:00080000:3.0:1788651836.899126:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c0700 x1875537147555200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651836.899134:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147555200:0@lo:400:kworker.0 00010000:00080000:3.0:1788651836.899144:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c1880 x1875537147555712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651836.899152:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147555712:0@lo:400:kworker.0 00010000:00080000:3.0:1788651836.899162:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff463480 x1875537147554304/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651836.899175:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147554304:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651836.899186:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147554816:0@lo:400:kworker.0 00010000:00080000:3.0:1788651836.899195:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c2a00 x1875537147555328/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651836.899203:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147555328:0@lo:400:kworker.0 00010000:00080000:3.0:1788651836.899211:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c0e00 x1875537147555840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651852 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651836.899218:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147555840:0@lo:400:kworker.0 00010000:00080000:3.0:1788651836.899250:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86fb1c9880 x1875537147554176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651852 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651836.899262:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147554176:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788651836.906742:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651837.920280:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651837.920516:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147556096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651837.920584:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651837.920661:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651837.920669:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147555968:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788651837.920695:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651837.920773:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147556096 00000100:00100000:1.0:1788651837.920782:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147556096 00000100:00100000:1.0:1788651837.920832:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147555968 00000100:00100000:1.0:1788651837.920835:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147555968 00000100:00100000:1.0:1788651837.920849:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788651837.920856:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147556096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651837.920882:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651837.920964:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147556096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651837.920971:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788651837.920986:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788651837.920992:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147555968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651837.921002:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651837.921022:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147555968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 30us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651837.921043:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1788651837.921178:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86fb1c9500 x1875537147555968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651837.921197:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147555968:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788651837.921208:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeaee680 x1875537147556096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651853 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651837.921231:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147556096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651838.944162:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147556224:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788651838.944251:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651838.944358:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651838.944429:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147556224 00000100:00100000:3.0:1788651838.944438:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147556224 00000100:00100000:3.0:1788651838.944489:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788651838.944498:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147556224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651838.944529:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651838.944591:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147556224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651838.944598:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788651838.944653:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147556224:0@lo:41:osp-pre-1-0.0 00000020:00000004:1.0:1788651839.123581:0:12496:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788651839.123772:0:12496:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788651839.969594:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651840.480030:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651840.480055:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147556352:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651840.480138:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651840.480214:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147556352 00000100:00100000:3.0:1788651840.480224:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147556352 00000100:00100000:3.0:1788651840.480270:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788651840.480279:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147556352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788651840.480320:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788651840.480365:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147556352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651840.480371:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788651840.480425:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147556352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651840.681580:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651840.681622:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651840.681652:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651840.681676:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651840.681693:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651840.681708:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651840.681729:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651840.681754:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125457664 00000100:00100000:2.0:1788651840.681762:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125457664 00000100:00100000:2.0:1788651840.681819:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125457920 00000100:00100000:2.0:1788651840.681823:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125457920 00000100:00100000:2.0:1788651840.681850:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125457792 00000100:00100000:2.0:1788651840.681852:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125457792 00000100:00100000:2.0:1788651840.681865:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125458048 00000100:00100000:2.0:1788651840.681868:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125458048 00000100:00100000:2.0:1788651840.681884:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 160 00000100:00100000:2.0:1788651840.681893:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125457664:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651840.681988:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125457664:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 96us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651840.681996:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 160 00000100:00100000:2.0:1788651840.682014:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 161 00000100:00100000:2.0:1788651840.682021:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125457920:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651840.682210:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 162 00000100:00100000:1.0:1788651840.682220:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125457792:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651840.682267:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125457920:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 246us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651840.682300:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 161 00000100:00100000:2.0:1788651840.682313:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 163 00000100:00100000:2.0:1788651840.682320:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125458048:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651840.683215:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125457536 00000100:00100000:3.0:1788651840.683224:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125457536 00000100:00100000:3.0:1788651840.683268:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 310 00000100:00100000:3.0:1788651840.683287:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125457536:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651840.686312:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125457792:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 4080us (4604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651840.686327:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 162 00000100:00100000:2.0:1788651840.686533:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125458048:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 4210us (4820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651840.686542:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 163 00000100:00100000:2.0:1788651840.686575:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125458176 00000100:00100000:2.0:1788651840.686584:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125458176 00000100:00100000:2.0:1788651840.686642:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125458304 00000100:00100000:2.0:1788651840.686645:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125458304 00000100:00100000:2.0:1788651840.686674:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 63 00000100:00100000:2.0:1788651840.686684:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125458176:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651840.686730:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125458176:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 48us (5053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651840.686737:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 63 00000100:00100000:2.0:1788651840.686749:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 64 00000100:00100000:2.0:1788651840.686756:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125458304:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651840.686779:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125458304:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 23us (5048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651840.686785:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 64 00000100:00080000:2.0:1788651840.686815:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651840.686819:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651840.686822:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788651840.686841:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651840.687683:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125457536:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 4403us (6104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651840.687694:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 310 00010000:00010000:2.0:1788651840.997543:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788651841.399794:0:12594:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788651841.400059:0:12594:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788651842.017341:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147556736:0@lo:400:kworker.0 00000100:00100000:3.0:1788651842.017419:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651842.017486:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147557248:0@lo:400:kworker.0 00000100:00100000:3.0:1788651842.017512:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651842.017536:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147557760:0@lo:400:kworker.0 00000100:00100000:3.0:1788651842.017557:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651842.017583:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788651842.017590:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147556864:0@lo:400:kworker.0 00000100:00100000:3.0:1788651842.017611:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651842.017626:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147557376:0@lo:400:kworker.0 00000100:00100000:3.0:1788651842.017647:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651842.017663:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147557888:0@lo:400:kworker.0 00000100:00100000:3.0:1788651842.017682:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651842.017799:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147557248 00000100:00100000:2.0:1788651842.017806:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147557248 00000100:00100000:2.0:1788651842.017860:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147557760 00000100:00100000:2.0:1788651842.017863:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147557760 00000100:00100000:2.0:1788651842.017879:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147556864 00000100:00100000:2.0:1788651842.017881:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147556864 00000100:00100000:2.0:1788651842.017893:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788651842.017902:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147557248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651842.017993:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147557248:12345-0@lo:400:kworker.0 Request processed in 92us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651842.018000:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788651842.018016:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788651842.018023:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147557760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651842.018050:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147557760:12345-0@lo:400:kworker.0 Request processed in 28us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651842.018056:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788651842.018067:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788651842.018072:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147556864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651842.018097:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147556864:12345-0@lo:400:kworker.0 Request processed in 25us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651842.018102:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788651842.018124:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147557376 00000100:00100000:2.0:1788651842.018128:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147557376 00000100:00100000:2.0:1788651842.018162:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147557888 00000100:00100000:2.0:1788651842.018166:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147557888 00000100:00100000:2.0:1788651842.018191:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788651842.018198:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147557376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651842.018227:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147557376:12345-0@lo:400:kworker.0 Request processed in 30us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651842.018248:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788651842.018260:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788651842.018265:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147557888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651842.018295:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147557888:12345-0@lo:400:kworker.0 Request processed in 30us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651842.018302:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788651842.018353:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147556864:0@lo:400:kworker.0 00010000:00080000:2.0:1788651842.018367:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3662a00 x1875537147557376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651842.018377:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3662a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147557376:0@lo:400:kworker.0 00010000:00080000:2.0:1788651842.018386:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3660380 x1875537147557888/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651842.018394:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147557888:0@lo:400:kworker.0 00010000:00080000:2.0:1788651842.018404:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeaee680 x1875537147557248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651842.018412:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147557248:0@lo:400:kworker.0 00010000:00080000:2.0:1788651842.018421:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3662d80 x1875537147557760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651842.018428:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3662d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147557760:0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.018681:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147556480:0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.018721:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651842.018762:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147556992:0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.018789:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651842.018810:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147557504:0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.018831:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651842.018844:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147558016:0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.018862:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651842.018879:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788651842.018885:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147556608:0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.018928:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651842.019036:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147556480 00000100:00100000:2.0:1788651842.019041:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147556480 00000100:00100000:2.0:1788651842.019077:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788651842.019085:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147556480:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788651842.019163:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651842.019169:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651842.019179:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651842.019204:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147557504 00000100:00100000:3.0:1788651842.019208:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147557504 00000100:00100000:3.0:1788651842.019238:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147558016 00000100:00100000:3.0:1788651842.019241:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147558016 00000100:00100000:3.0:1788651842.019260:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788651842.019267:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147557504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.019311:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147557120:0@lo:400:kworker.0 00000100:00100000:1.0:1788651842.019424:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147556608 00000100:00100000:1.0:1788651842.019428:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147556608 00000100:00100000:1.0:1788651842.019470:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788651842.019477:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147556608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651842.020070:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147556480:12345-0@lo:400:kworker.0 Request processed in 982us (1345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651842.020080:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788651842.020126:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788651842.020152:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147558016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651842.020188:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147558016:12345-0@lo:400:kworker.0 Request processed in 38us (1324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651842.020194:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788651842.020246:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651842.020250:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651842.020288:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147556736 00000100:00100000:2.0:1788651842.020294:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147556736 00000100:00100000:2.0:1788651842.020323:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147556992 00000100:00100000:2.0:1788651842.020326:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147556992 00000100:00100000:2.0:1788651842.020344:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788651842.020351:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147556736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651842.020390:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3661180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147556736:12345-0@lo:400:kworker.0 Request processed in 40us (2972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651842.020396:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788651842.020408:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788651842.020413:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147556992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651842.020441:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147556992:12345-0@lo:400:kworker.0 Request processed in 28us (1651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651842.020446:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788651842.020467:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651842.020479:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147558272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651842.021070:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651842.021175:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147556736:0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.022884:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651842.022999:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147557632:0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.023033:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651842.023068:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147557120 00000100:00100000:0.0:1788651842.023076:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147557120 00000100:00100000:0.0:1788651842.023126:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147557632 00000100:00100000:0.0:1788651842.023129:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147557632 00000100:00100000:0.0:1788651842.023168:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788651842.023177:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147557120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.023230:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147557120:12345-0@lo:400:kworker.0 Request processed in 54us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651842.023254:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788651842.023272:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788651842.023279:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147557632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.023309:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147557632:12345-0@lo:400:kworker.0 Request processed in 31us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651842.023314:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00010000:00010000:0.0:1788651842.023373:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651842.023400:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147557632:0@lo:400:kworker.0 00000100:00100000:0.0:1788651842.023409:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147558144:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788651842.023432:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651842.023642:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147556608:12345-0@lo:400:kworker.0 Request processed in 4164us (4732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651842.023649:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788651842.023674:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147558272 00000100:00100000:1.0:1788651842.023678:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147558272 00000100:00100000:1.0:1788651842.023699:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147558144 00000100:00100000:1.0:1788651842.023702:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147558144 00000100:00100000:1.0:1788651842.023713:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788651842.023719:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147558272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651842.023747:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651842.023788:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147558272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (3245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651842.023794:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788651842.023805:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788651842.023819:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147558144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788651842.024115:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651842.024153:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147558144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 336us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651842.024160:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788651842.024314:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86fb1cb800 x1875537147558272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651842.024331:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147558272:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788651842.024381:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff462300 x1875537147558144/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651858 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651842.024395:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147558144:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651842.024407:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147556480:0@lo:400:kworker.0 00000100:00100000:1.0:1788651842.024420:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147556992:0@lo:400:kworker.0 00010000:00080000:1.0:1788651842.024430:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3663b80 x1875537147558016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651842.024438:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3663b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147558016:0@lo:400:kworker.0 00000100:00080000:3.0:1788651842.024572:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651842.024606:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147557504:12345-0@lo:400:kworker.0 Request processed in 5339us (5773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651842.024614:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788651842.025105:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147556608:0@lo:400:kworker.0 00000100:00100000:1.0:1788651842.025119:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147557120:0@lo:400:kworker.0 00010000:00080000:1.0:1788651842.025129:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3660e00 x1875537147557504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651858 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651842.025150:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147557504:0@lo:400:kworker.0 00010000:00010000:2.0:1788651843.040416:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651843.040433:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651843.040456:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147558400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651843.040527:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651843.040649:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147558400 00000100:00100000:1.0:1788651843.040659:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147558400 00000100:00100000:1.0:1788651843.040716:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788651843.040726:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147558400:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651843.040759:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651843.040819:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147558400:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651843.040827:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:2.0:1788651843.041097:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86fb1cb800 x1875537147558400/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651843.041129:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147558400:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651843.042050:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651843.042066:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147558528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651843.042126:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651843.042281:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147558528 00000100:00100000:0.0:1788651843.042290:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147558528 00000100:00100000:0.0:1788651843.042337:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788651843.042346:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147558528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651843.042365:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651843.042410:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147558528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651843.042417:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:3.0:1788651843.042582:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5a300 x1875537147558528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651843.042600:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147558528:0@lo:13:osp-pre-0-0.0 00000020:00000004:0.0:1788651843.791845:0:12691:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788651843.792509:0:12691:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788651844.064145:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651844.066365:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651844.066389:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147558656:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788651844.066474:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651844.068567:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147558656 00000100:00100000:3.0:1788651844.068615:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147558656 00000100:00100000:3.0:1788651844.068686:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788651844.068696:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147558656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651844.068736:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651844.068813:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147558656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (2338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651844.068821:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788651844.069054:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147558656:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788651845.091367:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651845.601148:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651845.601171:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147558784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651845.601249:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651845.602265:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147558784 00000100:00100000:3.0:1788651845.602276:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147558784 00000100:00100000:3.0:1788651845.602330:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788651845.602340:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147558784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788651845.602374:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788651845.602458:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147558784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 119us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651845.602465:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788651845.605605:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147558784:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788651845.794303:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651845.794343:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651845.794368:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651845.794403:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651845.794421:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651845.794443:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651845.794470:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125458432 00000100:00100000:1.0:1788651845.794479:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125458432 00000100:00100000:1.0:1788651845.794532:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 312 00000100:00100000:1.0:1788651845.794542:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125458432:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651845.794625:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125458432:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651845.794633:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 312 00000100:00100000:1.0:1788651845.794663:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125458688 00000100:00100000:1.0:1788651845.794668:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125458688 00000100:00100000:1.0:1788651845.794700:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125458944 00000100:00100000:1.0:1788651845.794703:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125458944 00000100:00100000:1.0:1788651845.794723:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125458560 00000100:00100000:1.0:1788651845.794725:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125458560 00000100:00100000:1.0:1788651845.794735:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125458816 00000100:00100000:1.0:1788651845.794737:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125458816 00000100:00100000:1.0:1788651845.794749:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 170 00000100:00100000:1.0:1788651845.794755:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125458688:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651845.794792:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125458688:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 37us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651845.794798:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 170 00000100:00100000:1.0:1788651845.794809:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 171 00000100:00100000:1.0:1788651845.794815:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125458944:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651845.794835:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125458944:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 21us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651845.794841:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 171 00000100:00100000:1.0:1788651845.794850:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 172 00000100:00100000:1.0:1788651845.794856:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125458560:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651845.794884:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125458560:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 28us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651845.794889:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 172 00000100:00100000:1.0:1788651845.794899:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 173 00000100:00100000:1.0:1788651845.794944:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125458816:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651845.794968:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125458816:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 63us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651845.794975:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 173 00000100:00080000:1.0:1788651845.795001:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651845.795011:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788651845.797241:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125459072 00000100:00100000:0.0:1788651845.797258:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125459072 00000100:00100000:0.0:1788651845.797366:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:0.0:1788651845.797379:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2387:x1875537125459072:12345-192.168.204.45@tcp:9:kworker.0 00000020:00000080:0.0:1788651845.797408:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3d20 00000100:00080000:0.0:1788651845.797418:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f85c354b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788651845.797466:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788651845.797624:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+2:2387:x1875537125459072:12345-192.168.204.45@tcp:9:kworker.0 Request processed in 248us (3332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651845.797633:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 22 00010000:00010000:0.0:1788651845.797655:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651845.799517:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651845.799669:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125459200 00000100:00100000:0.0:1788651845.799678:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125459200 00000100:00100000:0.0:1788651845.799731:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:0.0:1788651845.799743:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2387:x1875537125459200:12345-192.168.204.45@tcp:9:kworker.0 00000020:00000080:0.0:1788651845.799772:0:8744:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3d27 00000100:00080000:0.0:1788651845.799779:0:8744:0:(import.c:65:import_set_state_nolock()) ffff8f85c3181000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788651845.799817:0:8744:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:0.0:1788651845.799982:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+2:2387:x1875537125459200:12345-192.168.204.45@tcp:9:kworker.0 Request processed in 242us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651845.799990:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 23 00010000:00010000:0.0:1788651845.800021:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788651845.801265:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651845.801282:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788651846.112675:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788651846.299365:0:12788:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788651846.299562:0:12788:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788651847.136147:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147558912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651847.136215:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651847.136378:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147558912 00000100:00100000:1.0:1788651847.136386:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147558912 00000100:00100000:1.0:1788651847.136434:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788651847.136443:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147558912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651847.136473:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651847.136519:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147558912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651847.136527:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788651847.136547:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788651847.136573:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86fb1c8000 x1875537147558912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651847.136591:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147558912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651847.137955:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147559040:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651847.138004:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651847.138469:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147559040 00000100:00100000:1.0:1788651847.138477:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147559040 00000100:00100000:1.0:1788651847.138522:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788651847.138530:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147559040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788651847.138553:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651847.138600:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3663b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147559040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 71us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651847.138607:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:1.0:1788651847.138638:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3660e00 x1875537147559040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651863 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651847.138653:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3660e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147559040:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788651847.139115:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788651847.146708:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651847.147551:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651847.147571:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147559168:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.147636:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651847.147687:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147559168 00000100:00100000:1.0:1788651847.147694:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147559168 00000100:00100000:1.0:1788651847.147737:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788651847.147745:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147559168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.147792:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147559168:12345-0@lo:400:kworker.0 Request processed in 47us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651847.147798:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:1.0:1788651847.147838:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147559168:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.147875:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147559296:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.147898:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651847.147941:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147559296 00000100:00100000:1.0:1788651847.147945:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147559296 00000100:00100000:1.0:1788651847.147969:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788651847.147975:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147559296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.148005:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147559296:12345-0@lo:400:kworker.0 Request processed in 30us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651847.148024:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788651847.148063:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147559296:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.148095:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147559424:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.148121:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651847.148150:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147559424 00000100:00100000:1.0:1788651847.148154:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147559424 00000100:00100000:1.0:1788651847.148190:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788651847.148196:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147559424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.148230:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147559424:12345-0@lo:400:kworker.0 Request processed in 35us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651847.148235:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788651847.148260:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147559424:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.148288:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147559552:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.148310:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651847.148335:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147559552 00000100:00100000:1.0:1788651847.148338:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147559552 00000100:00100000:1.0:1788651847.148604:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788651847.148611:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147559552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.148643:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147559552:12345-0@lo:400:kworker.0 Request processed in 34us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651847.148649:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788651847.148677:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147559552:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.148703:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651847.148708:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147559680:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.148729:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651847.148754:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147559680 00000100:00100000:1.0:1788651847.148757:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147559680 00000100:00100000:1.0:1788651847.148779:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788651847.148785:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147559680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.148818:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147559680:12345-0@lo:400:kworker.0 Request processed in 33us (88us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651847.148843:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788651847.148955:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147559680:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.149006:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147559808:0@lo:400:kworker.0 00000100:00100000:0.0:1788651847.151538:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651847.151556:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147560064:0@lo:400:kworker.0 00000100:00100000:0.0:1788651847.151616:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651847.151656:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147560064 00000100:00100000:0.0:1788651847.151662:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147560064 00000100:00100000:0.0:1788651847.151715:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788651847.151723:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147560064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651847.151767:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147560064:12345-0@lo:400:kworker.0 Request processed in 45us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651847.151773:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1788651847.151813:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3730000 x1875537147560064/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651847.151826:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147560064:0@lo:400:kworker.0 00000100:00100000:0.0:1788651847.151861:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147560192:0@lo:400:kworker.0 00000100:00100000:0.0:1788651847.151882:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651847.151921:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147560192 00000100:00100000:0.0:1788651847.151925:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147560192 00000100:00100000:0.0:1788651847.151951:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788651847.151957:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147560192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651847.151990:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147560192:12345-0@lo:400:kworker.0 Request processed in 33us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651847.151996:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:0.0:1788651847.152042:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3730000 x1875537147560192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651847.152060:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147560192:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.152270:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651847.152335:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147560320:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.152584:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651847.152633:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788651847.152640:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147559936:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.152872:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651847.152952:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147560448:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.152986:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788651847.153789:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651847.154787:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147559808 00000100:00100000:0.0:1788651847.154801:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147559808 00000100:00100000:0.0:1788651847.154869:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147560320 00000100:00100000:0.0:1788651847.154872:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147560320 00000100:00100000:0.0:1788651847.154888:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147559936 00000100:00100000:0.0:1788651847.154891:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147559936 00000100:00100000:0.0:1788651847.154903:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147560448 00000100:00100000:2.0:1788651847.157131:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788651847.157154:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147559808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651847.157265:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147559808:12345-0@lo:400:kworker.0 Request processed in 122us (4994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651847.157272:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788651847.157298:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788651847.157304:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147560320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651847.157332:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147560320:12345-0@lo:400:kworker.0 Request processed in 29us (4748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651847.157365:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788651847.157379:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788651847.157385:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147559936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651847.157415:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147559936:12345-0@lo:400:kworker.0 Request processed in 30us (4543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651847.157421:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00080000:3.0:1788651847.157739:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651847.157744:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651847.157863:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147560448 00000100:00100000:0.0:1788651847.157932:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788651847.157939:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147560448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651847.157975:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147560448:12345-0@lo:400:kworker.0 Request processed in 37us (4988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651847.157980:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:3.0:1788651847.158717:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788651847.161053:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb12d80 x1875537147559936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651847.161071:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147559936:0@lo:400:kworker.0 00010000:00080000:1.0:1788651847.161084:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3731f80 x1875537147560448/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651863 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651847.161092:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147560448:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.161104:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147560320:0@lo:400:kworker.0 00000100:00100000:1.0:1788651847.161114:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147559808:0@lo:400:kworker.0 00010000:00010000:0.0:1788651848.165056:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651848.165179:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651848.165203:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147560576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651848.165450:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651848.165509:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147560576 00000100:00100000:1.0:1788651848.165516:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147560576 00000100:00100000:1.0:1788651848.165581:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788651848.165590:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147560576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651848.165622:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651848.165678:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147560576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651848.165685:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:1.0:1788651848.166074:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86fb1c8000 x1875537147560576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651848.166094:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86fb1c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147560576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651848.166531:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147560704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651848.166570:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651848.166659:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147560704 00000100:00100000:2.0:1788651848.166665:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147560704 00000100:00100000:2.0:1788651848.166801:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788651848.166810:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147560704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651848.167075:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651848.167121:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147560704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 312us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651848.167128:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1788651848.167467:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3661880 x1875537147560704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651848.167483:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3661880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147560704:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1788651848.496353:0:12886:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788651848.496570:0:12886:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788651849.185418:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147560832:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788651849.185492:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651849.185735:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651849.186007:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147560832 00000100:00100000:2.0:1788651849.186015:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147560832 00000100:00100000:2.0:1788651849.186063:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788651849.186072:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147560832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788651849.186102:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788651849.193173:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147560832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 7085us (7664us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651849.193191:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788651849.202499:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147560832:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788651850.208454:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651850.720411:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651850.720434:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147560960:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788651850.720498:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651850.720554:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147560960 00000100:00100000:1.0:1788651850.720562:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147560960 00000100:00100000:1.0:1788651850.720605:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788651850.720614:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147560960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651850.720647:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788651850.720692:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147560960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651850.720699:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788651850.720749:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147560960:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651850.923649:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651850.923768:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651850.923807:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651850.923821:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125459584 00000100:00100000:1.0:1788651850.923833:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125459584 00000100:00100000:0.0:1788651850.923833:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651850.923862:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651850.923897:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125459840 00000100:00100000:1.0:1788651850.923900:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125459840 00000100:00100000:0.0:1788651850.924252:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125459456 00000100:00100000:0.0:1788651850.924259:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125459456 00000100:00100000:0.0:1788651850.924285:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125459712 00000100:00100000:0.0:1788651850.924287:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125459712 00000100:00100000:3.0:1788651850.924677:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125459328 00000100:00100000:3.0:1788651850.924683:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125459328 00000100:00100000:1.0:1788651850.924707:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 180 00000100:00100000:1.0:1788651850.924720:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125459584:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651850.924796:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 314 00000100:00100000:3.0:1788651850.924805:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2390:x1875537125459328:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651850.924856:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 181 00000100:00100000:0.0:1788651850.924865:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125459840:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651850.924979:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125459584:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 262us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651850.924987:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 180 00000100:00100000:1.0:1788651850.925007:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 182 00000100:00100000:1.0:1788651850.925013:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125459456:12345-192.168.204.45@tcp:400:kworker.0 00000100:00080000:2.0:1788651850.930383:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788651850.930395:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651850.931361:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2390:x1875537125459328:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 6548us (7714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651850.931374:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 314 00000100:00100000:3.0:1788651850.936109:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 183 00000100:00100000:3.0:1788651850.936130:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125459712:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651850.936235:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125459712:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 113us (12370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651850.936243:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 183 00000100:00100000:0.0:1788651850.939089:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125459840:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 14213us (15269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651850.939105:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 181 00000100:00100000:1.0:1788651850.941551:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125459456:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 16526us (17705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651850.941565:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 182 00010000:00010000:0.0:1788651851.232783:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651852.257390:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147561088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651852.257456:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651852.257514:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651852.257520:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147561216:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651852.257538:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651852.257573:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147561088 00000100:00100000:0.0:1788651852.257642:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147561216 00000100:00100000:0.0:1788651852.257647:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147561216 00000100:00100000:0.0:1788651852.257697:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788651852.257706:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147561216:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788651852.257731:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651852.257772:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147561216:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651852.257779:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788651852.257813:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147561088 00000100:00100000:1.0:1788651852.257867:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788651852.257874:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147561088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651852.257883:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651852.257945:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147561088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651852.257952:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1788651852.258254:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788651852.262538:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651852.263750:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147561344:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.263819:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651852.263858:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147561856:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.263880:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651852.263899:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147562368:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.263947:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651852.263971:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788651852.263977:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147561472:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.264012:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651852.264028:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147561984:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.264045:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651852.264059:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147562496:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.264092:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651852.264129:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147561856 00000100:00100000:0.0:1788651852.264137:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147561856 00000100:00100000:0.0:1788651852.264179:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788651852.264187:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147561856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.264234:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147561856:12345-0@lo:400:kworker.0 Request processed in 47us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651852.264241:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788651852.264261:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147562368 00000100:00100000:0.0:1788651852.264264:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147562368 00000100:00100000:0.0:1788651852.265396:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788651852.265407:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147562368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.265453:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147562368:12345-0@lo:400:kworker.0 Request processed in 48us (1517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651852.265459:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788651852.265479:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147561472 00000100:00100000:0.0:1788651852.265484:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147561472 00000100:00100000:0.0:1788651852.265506:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147561984 00000100:00100000:0.0:1788651852.265508:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147561984 00000100:00100000:0.0:1788651852.265523:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147562496 00000100:00100000:0.0:1788651852.265525:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147562496 00000100:00100000:0.0:1788651852.265536:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788651852.265541:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147561472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.265570:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147561472:12345-0@lo:400:kworker.0 Request processed in 29us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651852.265576:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788651852.265748:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788651852.265755:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147561984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.265797:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147561984:12345-0@lo:400:kworker.0 Request processed in 44us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651852.265804:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788651852.265815:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788651852.265821:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147562496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.265850:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147562496:12345-0@lo:400:kworker.0 Request processed in 29us (1756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651852.265855:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1788651852.265890:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651852.265895:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651852.265990:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147561344 00000100:00100000:2.0:1788651852.265995:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147561344 00000100:00100000:2.0:1788651852.266021:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788651852.266027:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147561344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651852.266057:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147561344:12345-0@lo:400:kworker.0 Request processed in 31us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651852.266063:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788651852.266093:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147561728:0@lo:400:kworker.0 00000100:00100000:2.0:1788651852.266117:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651852.266135:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147562240:0@lo:400:kworker.0 00000100:00100000:2.0:1788651852.266153:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651852.266169:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788651852.266174:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147561600:0@lo:400:kworker.0 00000100:00100000:2.0:1788651852.266191:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651852.266204:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147562112:0@lo:400:kworker.0 00000100:00100000:2.0:1788651852.266218:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651852.266229:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147562624:0@lo:400:kworker.0 00000100:00100000:2.0:1788651852.266243:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788651852.266818:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3733800 x1875537147561216/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651852.266841:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147561216:0@lo:13:osp-pre-1-1.0 00010000:00080000:2.0:1788651852.266855:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d7100 x1875537147561088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651868 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651852.266880:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147561088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651852.267965:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147562240 00000100:00100000:0.0:1788651852.267975:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147562240 00000100:00100000:0.0:1788651852.268025:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788651852.268033:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147562240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.268097:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147562240:12345-0@lo:400:kworker.0 Request processed in 65us (1943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651852.268104:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788651852.268125:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147561600 00000100:00100000:0.0:1788651852.268129:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147561600 00000100:00100000:0.0:1788651852.268148:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788651852.268153:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147561600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.268180:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147561600:12345-0@lo:400:kworker.0 Request processed in 27us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651852.268186:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788651852.268213:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147561600:0@lo:400:kworker.0 00010000:00080000:0.0:1788651852.268226:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ea15d500 x1875537147562240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651852.268242:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147562240:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.268774:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147561728 00000100:00100000:0.0:1788651852.268780:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147561728 00000100:00100000:0.0:1788651852.268812:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147562112 00000100:00100000:0.0:1788651852.268815:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147562112 00000100:00100000:0.0:1788651852.268834:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147562624 00000100:00100000:0.0:1788651852.268837:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147562624 00000100:00100000:0.0:1788651852.268851:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788651852.268857:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147561728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.268900:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3661880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147561728:12345-0@lo:400:kworker.0 Request processed in 43us (2782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651852.268928:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788651852.268953:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788651852.268960:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147562112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.268989:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147562112:12345-0@lo:400:kworker.0 Request processed in 30us (2769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651852.268994:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788651852.269004:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788651852.269009:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147562624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.269028:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147562624:12345-0@lo:400:kworker.0 Request processed in 19us (2784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651852.269033:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00010000:00080000:0.0:1788651852.269079:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c310aa00 x1875537147562112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651852.269090:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147562112:0@lo:400:kworker.0 00010000:00080000:0.0:1788651852.269109:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c1880 x1875537147562624/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651852.269117:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147562624:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.269126:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147561728:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.269180:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147561472:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.269190:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147561984:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.269199:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147562496:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.269208:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147561344:0@lo:400:kworker.0 00000100:00100000:0.0:1788651852.269218:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147561856:0@lo:400:kworker.0 00010000:00080000:0.0:1788651852.269228:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c0e00 x1875537147562368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651868 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651852.269237:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147562368:0@lo:400:kworker.0 00000100:00080000:3.0:1788651852.270994:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651852.271002:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788651852.272753:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000020:00000080:2.0:1788651852.272761:0:8422:0:(genops.c:885:class_export_put()) final put ffff8f85c354f000/029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000001:00100000:0.0:1788651852.277409:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000020:00000080:0.0:1788651852.277419:0:9506:0:(genops.c:885:class_export_put()) final put ffff8f85c3187000/029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000020:00000080:3.0:1788651852.278671:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c354f000/029f4676-f465-4d1e-a0cb-3243b2e8fb58 for lustre-OST0000 00000020:00000080:3.0:1788651852.279470:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c354b800 for lustre-OST0000 00000020:00000080:3.0:1788651852.283751:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3187000/029f4676-f465-4d1e-a0cb-3243b2e8fb58 for lustre-OST0001 00000020:00000080:3.0:1788651852.283794:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3181000 for lustre-OST0001 00000001:02000400:1.0:1788651852.612505:0:13030:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788651853.280405:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651853.280430:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147562752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651853.280502:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651853.280549:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147562880:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651853.280580:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651853.280672:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147562752 00000100:00100000:1.0:1788651853.280680:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147562752 00000100:00100000:1.0:1788651853.280717:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147562880 00000100:00100000:1.0:1788651853.280720:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147562880 00000100:00100000:1.0:1788651853.280735:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788651853.280744:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147562752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651853.280773:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651853.280829:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147562752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651853.280836:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788651853.280853:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788651853.280859:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147562880:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651853.280869:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651853.280896:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147562880:12345-0@lo:13:osp-pre-0-1.0 Request processed in 37us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651853.280902:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00010000:0.0:1788651853.280989:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788651853.281206:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeaefb80 x1875537147562880/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651853.281224:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147562880:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788651853.281252:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeaeca80 x1875537147562752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651869 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651853.281263:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147562752:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788651854.305481:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651854.314413:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651854.314437:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147563008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651854.314511:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651854.314798:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147563008 00000100:00100000:0.0:1788651854.314806:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147563008 00000100:00100000:0.0:1788651854.314864:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788651854.314874:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147563008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788651854.314951:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788651854.315001:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147563008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 128us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651854.315040:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788651854.315433:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147563008:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788651855.331023:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651855.846161:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147563136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651855.846248:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651855.846552:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147563136 00000100:00100000:1.0:1788651855.846560:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147563136 00000100:00100000:1.0:1788651855.846611:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788651855.846620:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147563136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651855.846664:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788651855.846718:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147563136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651855.846726:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788651855.847148:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147563136:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651856.038664:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651856.038704:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651856.038751:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651856.038783:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651856.038816:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651856.038846:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125460224 00000100:00100000:0.0:1788651856.038855:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125460224 00000100:00100000:1.0:1788651856.039005:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125460480 00000100:00100000:1.0:1788651856.039010:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125460480 00000100:00100000:1.0:1788651856.039053:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125460096 00000100:00100000:1.0:1788651856.039056:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125460096 00000100:00100000:1.0:1788651856.039070:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125460352 00000100:00100000:1.0:1788651856.039073:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125460352 00000100:00100000:1.0:1788651856.039091:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 190 00000100:00100000:1.0:1788651856.039102:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125460480:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651856.039192:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125460480:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 80us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651856.039201:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 190 00000100:00100000:1.0:1788651856.039219:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 191 00000100:00100000:1.0:1788651856.039226:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125460096:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651856.039254:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125460096:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651856.039260:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 191 00000100:00100000:1.0:1788651856.039271:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 192 00000100:00100000:1.0:1788651856.039277:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125460352:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651856.039303:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125460352:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 25us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651856.039309:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 192 00000100:00080000:1.0:1788651856.039362:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651856.039366:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651856.040115:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125459968 00000100:00100000:3.0:1788651856.040124:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125459968 00000100:00100000:3.0:1788651856.040168:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 316 00000100:00100000:3.0:1788651856.040185:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125459968:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651856.040231:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125459968:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 57us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651856.040238:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 316 00000100:00100000:0.0:1788651856.040631:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 193 00000100:00100000:0.0:1788651856.040641:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125460224:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651856.040850:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125460224:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 211us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651856.040858:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 193 00010000:00010000:0.0:1788651856.352066:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788651857.017550:0:13178:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe19b2b550 20000000:00000080:2.0:1788651857.017565:0:13178:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f86fce2e400 uarg=0000000000000000 20000000:01000000:2.0:1788651857.017601:0:13178:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788651857.017606:0:13178:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788651857.017610:0:13178:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788651857.018821:0:13179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788651857.019073:0:13178:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788651857.034231:0:13178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788651857.036887:0:13178:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.036929:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3cc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3cbe expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.036938:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c3cd3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ccc expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.036945:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ce1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3cda expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.036951:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c3cef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ce8 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.036980:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3cf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b38 expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.036987:0:13178:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b77 expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.036996:0:13178:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.037046:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b77 expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.037066:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3d0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b77 expref: 12 pid: 6502 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651857.037085:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3731880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563264:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651857.037219:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3cf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b38 expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.037228:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3cf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b38 expref: 12 pid: 6502 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651857.037237:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563392:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651857.037268:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c3cef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3ce8 expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.037275:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c3cef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ce8 expref: 23 pid: 6505 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651857.037296:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563520:0@lo:104: 00000100:00100000:0.0:1788651857.037338:0:13178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651857.037383:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ce1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3cda expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.037390:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ce1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3cda expref: 23 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651857.037398:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563648:0@lo:104: 00000100:00100000:0.0:1788651857.037417:0:13178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651857.037439:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c3cd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3ccc expref: 23 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.037447:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c3cd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ccc expref: 23 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651857.037454:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563776:0@lo:104: 00000100:00100000:0.0:1788651857.037473:0:13178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.037483:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147563520 00000100:00100000:3.0:1788651857.037493:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147563520 00000100:00100000:0.0:1788651857.037515:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147563648 00000100:00100000:0.0:1788651857.037519:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147563648 00000100:00100000:3.0:1788651857.037542:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147563776 00000100:00100000:3.0:1788651857.037544:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147563776 00000100:00100000:0.0:1788651857.037547:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788651857.037555:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788651857.037555:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:13178:x1875537147563648:12345-0@lo:104: 00000100:00100000:3.0:1788651857.037560:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:13178:x1875537147563520:12345-0@lo:104: 00010000:00010000:0.0:1788651857.037569:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.037573:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.037612:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788651857.037934:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+5:13178:x1875537147563648:12345-0@lo:104: Request processed in 350us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651857.037950:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788651857.037969:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788651857.037975:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:13178:x1875537147563776:12345-0@lo:104: 00010000:00010000:0.0:1788651857.037983:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.040392:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788651857.040412:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:13178:x1875537147563520:12345-0@lo:104: Request processed in 2845us (3067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.040424:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00010000:3.0:1788651857.040632:0:13178:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3cc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3cbe expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.040648:0:13178:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3cc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3cbe expref: 23 pid: 6504 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651857.040663:0:13178:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563904:0@lo:104: 00000100:00100000:3.0:1788651857.040727:0:13178:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.040762:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147563904 00000100:00100000:3.0:1788651857.040769:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147563904 00000100:00100000:3.0:1788651857.040802:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788651857.040810:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:13178:x1875537147563904:12345-0@lo:104: 00010000:00010000:3.0:1788651857.040823:0:6494:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.040886:0:6494:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788651857.040892:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:13178:x1875537147563904:12345-0@lo:104: Request processed in 83us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.040898:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788651857.040941:0:13178:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fb18c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788651857.040965:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563520:0@lo:104: 00000100:00100000:3.0:1788651857.040995:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563648:0@lo:104: 00000100:00100000:3.0:1788651857.041004:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563776:0@lo:104: 00000100:00100000:3.0:1788651857.041012:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563904:0@lo:104: 00010000:00010000:3.0:1788651857.041036:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788651857.041042:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.041758:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651857.041765:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.041776:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651857.041784:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651857.041790:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788651857.041835:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.041854:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651857.041875:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.041882:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86ff414e00/0xcd2f56ea038c3cda lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3ce1 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.041898:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788651857.041933:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.041938:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651857.041941:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.041948:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651857.041954:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651857.041959:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788651857.041973:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.041979:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651857.041993:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.041999:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5200/0xcd2f56ea038c3ce8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3cef expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042010:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788651857.042013:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042018:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651857.042021:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042037:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651857.042043:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651857.042047:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788651857.042139:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042145:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651857.042151:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042157:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3ccc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3cd3 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042165:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651857.042168:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042173:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dcc00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651857.042176:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042183:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651857.042189:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651857.042200:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788651857.042213:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042219:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651857.042225:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042231:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c29dcc00/0xcd2f56ea038c3cbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3cc5 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.042236:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651857.042253:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147564288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651857.042306:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651857.042336:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651857.042341:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147564160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651857.042358:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651857.042388:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147564288 00000100:00100000:1.0:1788651857.042394:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147564288 00010000:00010000:1.0:1788651857.042420:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c3cd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ccc expref: 24 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651857.042442:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147564160 00000100:00100000:1.0:1788651857.042445:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147564160 00010000:00010000:1.0:1788651857.042457:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c3cef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ce8 expref: 25 pid: 6505 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651857.042478:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788651857.042506:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+25:3638:x1875537147564288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651857.042519:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651857.042525:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c3cd3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ccc expref: 25 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.042535:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c3cd3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ccc expref: 25 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.042549:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dc600/0xcd2f56ea038c3cd3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3ccc expref: 25 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042551:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651857.042553:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651857.042555:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651857.042572:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651857.042590:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788651857.042597:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147564160:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651857.042602:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147564288:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (297us total) trans 0 rc 0/0 00010000:00010000:3.0:1788651857.042606:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788651857.042608:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788651857.042611:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c3cef lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ce8 expref: 24 pid: 6505 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042619:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c3cef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3ce8 expref: 23 pid: 6505 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042629:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff415800/0xcd2f56ea038c3cef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3ce8 expref: 23 pid: 6505 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.042637:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651857.042641:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147564288:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651857.042658:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147564160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651857.042659:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3638:x1875537147564160:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.042674:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788651857.042692:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147564032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651857.042716:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.042744:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651857.042750:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147564416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651857.042770:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651857.042998:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147564032 00000100:00100000:1.0:1788651857.043005:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147564032 00010000:00010000:1.0:1788651857.043021:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ce1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3cda expref: 22 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651857.043039:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147564416 00000100:00100000:1.0:1788651857.043043:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147564416 00010000:00010000:1.0:1788651857.043068:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3cc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3cbe expref: 23 pid: 6504 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651857.043080:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788651857.043086:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:3636:x1875537147564032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651857.043094:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651857.043097:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ce1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3cda expref: 23 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.043105:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ce1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3cda expref: 23 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.043116:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff415000/0xcd2f56ea038c3ce1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3cda expref: 23 pid: 6502 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.043135:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651857.043165:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3636:x1875537147564032:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651857.043172:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788651857.043185:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788651857.043191:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3636:x1875537147564416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651857.043212:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651857.043216:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3cc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3cbe expref: 21 pid: 6504 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.043224:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3cc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3cbe expref: 21 pid: 6504 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.043248:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3cc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3cbe expref: 21 pid: 6504 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.043258:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651857.043279:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:3636:x1875537147564416:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651857.043284:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788651857.043325:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147564416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651857.043332:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147564032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651857.043878:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651857.043979:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125460608 00000100:00100000:1.0:1788651857.043984:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125460608 00010000:00010000:1.0:1788651857.044002:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3d0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b77 expref: 13 pid: 6502 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651857.044033:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 44 00000100:00100000:1.0:1788651857.044040:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125460608:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651857.044062:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651857.044067:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3d0b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b77 expref: 13 pid: 6502 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.044078:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3d0b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b77 expref: 13 pid: 6502 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.044089:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651857.044126:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125460608:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 86us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651857.044133:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 44 00010000:00010000:1.0:1788651857.044169:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dd200/0xcd2f56ea038c3d0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b77 expref: 12 pid: 6502 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651857.044178:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3731880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563264:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651857.044187:0:13178:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13178:1875537147563392:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651857.044216:0:13178:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651857.044502:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1788651857.044513:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:13178:x1875537147563776:12345-0@lo:104: Request processed in 6536us (7037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651857.044522:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:1.0:1788651857.044734:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651857.046027:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651857.049577:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651857.050904:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125460736 00000100:00100000:1.0:1788651857.050932:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125460736 00010000:00010000:1.0:1788651857.050977:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3cf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b38 expref: 12 pid: 6502 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651857.051029:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 45 00000100:00100000:1.0:1788651857.051039:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:2389:x1875537125460736:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651857.051055:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651857.051061:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3cf6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b38 expref: 12 pid: 6502 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051074:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3cf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b38 expref: 12 pid: 6502 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051091:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c29dc400/0xcd2f56ea038c3cf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b38 expref: 12 pid: 6502 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051110:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051119:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051136:0:6497:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051143:0:6497:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051149:0:6497:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051169:0:6497:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051185:0:6497:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651857.051190:0:6497:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051200:0:6497:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051216:0:6497:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051228:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651857.051277:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:2389:x1875537125460736:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 240us (1711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651857.051285:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 45 00010000:00010000:1.0:1788651857.051347:0:13178:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051356:0:13178:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651857.051362:0:13178:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4a00/0xcd2f56ea038c3d2e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13178 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651857.382357:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651857.382720:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147564544:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.382800:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.382862:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147565056:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.382891:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.382928:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147565568:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.382952:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.382972:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147566080:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.382992:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.383016:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788651857.383022:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147564928:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383046:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.383065:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147565440:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383083:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.383098:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147565952:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.383164:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147564672:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383208:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.383230:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147565184:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383252:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.383267:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147565696:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383284:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.383301:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788651857.383306:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147564800:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383323:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.383337:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147565312:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383354:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.383371:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147565824:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383388:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651857.383415:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147564544 00000100:00100000:3.0:1788651857.383421:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147564544 00000100:00100000:3.0:1788651857.383468:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788651857.383477:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:3636:x1875537147564544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383526:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:3636:x1875537147564544:12345-0@lo:400:kworker.0 Request processed in 50us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.383534:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:3.0:1788651857.383567:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147565056 00000100:00100000:3.0:1788651857.383571:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147565056 00000100:00100000:3.0:1788651857.383595:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147564800 00000100:00100000:3.0:1788651857.383598:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147564800 00000100:00100000:3.0:1788651857.383612:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788651857.383618:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147565056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383663:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147565056:12345-0@lo:400:kworker.0 Request processed in 44us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.383669:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788651857.383683:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788651857.383689:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147564800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383719:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff44a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147564800:12345-0@lo:400:kworker.0 Request processed in 30us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.383725:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788651857.383743:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147565568 00000100:00100000:3.0:1788651857.383746:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147565568 00000100:00100000:3.0:1788651857.383777:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147566080 00000100:00100000:3.0:1788651857.383780:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147566080 00000100:00100000:3.0:1788651857.383791:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147565440 00000100:00100000:3.0:1788651857.383794:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147565440 00000100:00100000:3.0:1788651857.383806:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147565952 00000100:00100000:3.0:1788651857.383809:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147565952 00000100:00100000:3.0:1788651857.383821:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788651857.383827:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147565568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383872:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147565568:12345-0@lo:400:kworker.0 Request processed in 45us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.383878:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788651857.383889:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788651857.383894:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147566080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.383949:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147566080:12345-0@lo:400:kworker.0 Request processed in 54us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.383955:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788651857.383965:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788651857.383979:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147565440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384010:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147565440:12345-0@lo:400:kworker.0 Request processed in 32us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.384016:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788651857.384027:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788651857.384033:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147565952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384057:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147565952:12345-0@lo:400:kworker.0 Request processed in 25us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.384063:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788651857.384087:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147564928 00000100:00100000:3.0:1788651857.384091:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147564928 00000100:00100000:3.0:1788651857.384108:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147564672 00000100:00100000:3.0:1788651857.384110:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147564672 00000100:00100000:3.0:1788651857.384117:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147565184 00000100:00100000:3.0:1788651857.384120:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147565184 00000100:00100000:3.0:1788651857.384130:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147565696 00000100:00100000:3.0:1788651857.384132:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147565696 00000100:00100000:3.0:1788651857.384142:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147565312 00000100:00100000:3.0:1788651857.384144:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147565312 00000100:00100000:3.0:1788651857.384154:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147565824 00000100:00100000:3.0:1788651857.384156:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147565824 00000100:00100000:3.0:1788651857.384169:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788651857.384174:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147564928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384216:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147564928:12345-0@lo:400:kworker.0 Request processed in 41us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.384222:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788651857.384235:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788651857.384241:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147564672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384281:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff449500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147564672:12345-0@lo:400:kworker.0 Request processed in 40us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.384287:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788651857.384299:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788651857.384305:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147565184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384329:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff44b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147565184:12345-0@lo:400:kworker.0 Request processed in 25us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.384335:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1788651857.384344:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788651857.384349:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147565696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384374:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff44b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147565696:12345-0@lo:400:kworker.0 Request processed in 25us (1089us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.384380:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788651857.384390:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788651857.384395:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147565312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384419:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff449c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147565312:12345-0@lo:400:kworker.0 Request processed in 24us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.384425:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1788651857.384435:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1788651857.384440:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147565824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384465:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff448700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147565824:12345-0@lo:400:kworker.0 Request processed in 25us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651857.384470:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:3.0:1788651857.384519:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651857.384523:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651857.384532:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651857.384534:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651857.384569:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147564800:0@lo:400:kworker.0 00010000:00080000:3.0:1788651857.384583:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c3800 x1875537147565312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651857.384593:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147565312:0@lo:400:kworker.0 00010000:00080000:3.0:1788651857.384603:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff446680 x1875537147565824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651857.384611:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147565824:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384620:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147564672:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384628:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147565184:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384636:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147565696:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384675:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147564928:0@lo:400:kworker.0 00010000:00080000:3.0:1788651857.384687:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c1f80 x1875537147565440/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651857.384695:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147565440:0@lo:400:kworker.0 00010000:00080000:3.0:1788651857.384705:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff447100 x1875537147565952/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651857.384712:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147565952:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384720:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147564544:0@lo:400:kworker.0 00000100:00100000:3.0:1788651857.384731:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147565056:0@lo:400:kworker.0 00010000:00080000:3.0:1788651857.384750:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff446a00 x1875537147565568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651857.384758:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147565568:0@lo:400:kworker.0 00010000:00080000:3.0:1788651857.384768:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff444e00 x1875537147566080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651873 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651857.384775:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147566080:0@lo:400:kworker.0 00000100:00100000:0.0:1788651857.387085:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651857.387107:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147566208:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788651857.387185:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651857.387233:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147566208 00000100:00100000:0.0:1788651857.387253:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147566208 00000100:00100000:0.0:1788651857.387296:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788651857.387303:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147566208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788651857.387328:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651857.387366:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147566208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651857.387372:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:0.0:1788651857.387410:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a58700 x1875537147566208/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651857.387427:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147566208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651857.390886:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651857.390939:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147566336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651857.391019:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651857.391117:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147566336 00000100:00100000:2.0:1788651857.391126:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147566336 00000100:00100000:2.0:1788651857.391183:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788651857.391193:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147566336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651857.391866:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651857.391974:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147566336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 782us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651857.391982:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1788651857.392345:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff448a80 x1875537147566336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651873 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651857.392366:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff448a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147566336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651858.082421:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651858.082534:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125460864 00000100:00100000:2.0:1788651858.082547:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125460864 00000100:00100000:2.0:1788651858.082615:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 318 00000100:00100000:2.0:1788651858.082626:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:6166:x1875537125460864:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651858.082669:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651858.082689:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c3d35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ba8 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651858.082720:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c3d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ba8 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651858.082732:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c3d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ba8 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651858.082742:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dda00, rc 0) 00000100:00100000:2.0:1788651858.082831:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125460864:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 Request processed in 197us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651858.082839:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 318 00000100:00100000:2.0:1788651858.087006:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651858.087163:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125460992 00000100:00100000:3.0:1788651858.087172:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125460992 00000100:00100000:3.0:1788651858.087225:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 319 00000100:00100000:3.0:1788651858.087234:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125460992:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651858.087538:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125460992:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 Request processed in 303us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651858.087546:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 319 00000100:00100000:0.0:1788651858.097251:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651858.097725:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125461120 00000100:00100000:3.0:1788651858.097737:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125461120 00000100:00100000:3.0:1788651858.097799:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 320 00000100:00100000:3.0:1788651858.097819:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125461120:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651858.097998:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125461120:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 Request processed in 181us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651858.098007:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 320 00000100:00100000:0.0:1788651858.113150:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651858.113451:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125461248 00000100:00100000:3.0:1788651858.113463:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125461248 00000100:00100000:3.0:1788651858.113581:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 321 00000100:00100000:3.0:1788651858.113593:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125461248:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651858.113611:0:6502:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651858.113630:0:6502:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3d3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33baf expref: -99 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651858.113661:0:6502:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33baf expref: 13 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651858.113674:0:6502:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33baf expref: 13 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651858.113684:0:6502:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dcc00, rc 0) 00000100:00100000:3.0:1788651858.114918:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:6166:x1875537125461248:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 Request processed in 1306us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651858.114931:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 321 00000100:00100000:2.0:1788651858.126231:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651858.134519:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125461376 00000100:00100000:3.0:1788651858.134537:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125461376 00000100:00100000:2.0:1788651858.138244:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 322 00000100:00100000:2.0:1788651858.138258:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:6166:x1875537125461376:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651858.138468:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:6166:x1875537125461376:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 Request processed in 211us (12245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651858.138478:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 322 00000100:00100000:0.0:1788651858.146329:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651858.148410:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125461504 00000100:00100000:3.0:1788651858.148427:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125461504 00000100:00100000:3.0:1788651858.148507:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 323 00000100:00100000:3.0:1788651858.148519:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:6166:x1875537125461504:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651858.148697:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:6166:x1875537125461504:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 Request processed in 179us (2377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651858.148706:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 323 00010000:00010000:0.0:1788651858.413924:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651858.416682:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147566592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788651858.416747:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147566464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651858.427791:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651858.430696:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147566464 00000100:00100000:2.0:1788651858.430712:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147566464 00000100:00100000:2.0:1788651858.430857:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788651858.430868:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147566464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651858.430930:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651858.431012:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147566464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651858.431020:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:0.0:1788651858.431141:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeaeed80 x1875537147566464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651858.431162:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147566464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651858.438988:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651858.439044:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147566592 00000100:00100000:1.0:1788651858.439053:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147566592 00000100:00100000:1.0:1788651858.439114:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788651858.439123:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147566592:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651858.439161:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651858.439224:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147566592:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651858.439231:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:0.0:1788651858.439588:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeaeca80 x1875537147566592/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651874 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651858.439614:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaeca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147566592:0@lo:13:osp-pre-0-1.0 10000000:01000000:3.0:1788651858.719984:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788651858.720002:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f85c196d800 from 7 10000000:01000000:3.0:1788651858.720007:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788651858.720052:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651858.720064:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651858.720075:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651858.720100:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147566720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788651858.720165:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651858.720229:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952540 going to sleep for 11 seconds 00000100:00100000:0.0:1788651858.720345:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147566720 00000100:00100000:0.0:1788651858.720353:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147566720 00000100:00100000:0.0:1788651858.720418:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788651858.720428:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147566720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651858.720441:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651858.720456:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c3d4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3d43 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.720478:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c3d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d43 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.720489:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c3d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d43 expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.720498:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5800, rc 0) 00000100:00100000:0.0:1788651858.720542:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147566720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651858.720555:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788651858.720784:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff448a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147566720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651858.720800:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651858.720821:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651858.721282:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147566848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.721314:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651858.721345:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651858.721458:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147566848 00000100:00100000:3.0:1788651858.721464:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147566848 00000100:00100000:3.0:1788651858.721497:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788651858.721504:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147566848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651858.721627:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147566848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651858.721647:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788651858.721784:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147566848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.721826:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147566976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.721870:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651858.721893:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651858.722044:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147566976 00000100:00100000:0.0:1788651858.722048:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147566976 00000100:00100000:0.0:1788651858.722088:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788651858.722095:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147566976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651858.722182:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147566976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651858.722188:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788651858.722338:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147566976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788651858.726237:0:13234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788651858.726463:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788651858.726485:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788651858.726496:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.726509:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651858.726518:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788651858.726521:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86eeab9800 from 7 10000000:01000000:0.0:1788651858.726524:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788651858.726565:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.726574:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.726584:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651858.726610:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788651858.726682:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651858.726726:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fb18cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651858.727192:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147567104 00000100:00100000:1.0:1788651858.727200:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147567104 00000100:00100000:1.0:1788651858.727263:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788651858.727274:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147567104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651858.727306:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651858.727320:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3d58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3d51 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651858.727343:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d51 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651858.727352:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d51 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651858.727360:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415200, rc 0) 00000100:00100000:1.0:1788651858.727405:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147567104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651858.727411:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788651858.727456:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651858.727469:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651858.727478:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651858.727537:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.727563:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651858.727581:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788651858.727658:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147567232 00000100:00100000:3.0:1788651858.727663:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147567232 00000100:00100000:3.0:1788651858.727695:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788651858.727702:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147567232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651858.727831:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147567232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 126us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651858.727839:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:1.0:1788651858.728382:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.728416:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.728467:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651858.728496:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788651858.728573:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147567360 00000100:00100000:3.0:1788651858.728584:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147567360 00000100:00100000:3.0:1788651858.728772:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788651858.728781:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147567360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651858.728890:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147567360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651858.728897:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788651858.728998:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788651858.729679:0:13235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788651858.729731:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788651858.729747:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788651858.729756:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651858.729768:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651858.729779:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788651858.729782:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86f48d9800 from 7 10000000:01000000:1.0:1788651858.729784:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788651858.729818:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651858.729827:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651858.729837:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651858.729854:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.729888:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651858.735646:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651858.735936:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147567488 00000100:00100000:0.0:1788651858.735947:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147567488 00000100:00100000:0.0:1788651858.736001:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788651858.736010:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147567488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788651858.736028:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651858.736046:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3d66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3d5f expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.736074:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d5f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.736087:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d5f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.736097:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5200, rc 0) 00000100:00100000:0.0:1788651858.736158:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147567488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (6269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651858.736165:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788651858.742772:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651858.742802:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651858.742838:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651858.742950:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.743011:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651858.743051:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651858.743155:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147567616 00000100:00100000:0.0:1788651858.743162:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147567616 00000100:00100000:0.0:1788651858.743212:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:0.0:1788651858.743220:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147567616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651858.743572:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147567616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651858.743580:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788651858.749390:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.749458:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.749528:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651858.749627:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651858.751765:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147567744 00000100:00100000:0.0:1788651858.751800:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147567744 00000100:00100000:0.0:1788651858.751870:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788651858.751880:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147567744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651858.752039:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147567744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (2510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651858.752048:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788651858.752304:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788651858.753461:0:13236:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788651858.754125:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788651858.754148:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788651858.754159:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.754172:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651858.754184:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788651858.754187:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86da667000 from 7 10000000:01000000:0.0:1788651858.754190:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788651858.754306:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.754315:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651858.754326:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651858.754349:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788651858.754403:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651858.754488:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fb18c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651858.756187:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147567872 00000100:00100000:3.0:1788651858.756200:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147567872 00000100:00100000:3.0:1788651858.756265:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:3.0:1788651858.756275:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147567872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651858.756291:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651858.756308:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c29dc200/0xcd2f56ea038c3d74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3d6d expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651858.756336:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c29dc200/0xcd2f56ea038c3d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d6d expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651858.756349:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c29dc200/0xcd2f56ea038c3d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d6d expref: 24 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651858.756359:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dc200, rc 0) 00000100:00100000:3.0:1788651858.756467:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147567872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (2063us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651858.756474:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788651858.757069:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147567872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651858.757088:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651858.757099:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651858.757239:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff449180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147568000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651858.757275:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651858.757312:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651858.757401:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147568000 00000100:00100000:1.0:1788651858.757406:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147568000 00000100:00100000:1.0:1788651858.757445:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788651858.757453:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147568000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.757571:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147568000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651858.757586:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:0.0:1788651858.757656:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff449180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147568000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651858.757693:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147568128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651858.757733:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651858.757755:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fb18c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651858.757937:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147568128 00000100:00100000:1.0:1788651858.757942:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147568128 00000100:00100000:1.0:1788651858.757969:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788651858.757976:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147568128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651858.758052:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147568128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651858.758059:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:0.0:1788651858.758138:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147568128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788651858.759098:0:13237:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788651858.759455:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788651858.759480:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788651858.759490:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651858.759502:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651859.424338:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651859.427097:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147568256:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651859.430973:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651859.431457:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147568256 00000100:00100000:2.0:1788651859.431467:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147568256 00000100:00100000:2.0:1788651859.431520:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788651859.431529:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147568256:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788651859.431565:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788651859.433099:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff44a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147568256:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1564us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651859.433110:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788651859.433720:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147568256:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788651860.448165:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651860.962885:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147568384:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651860.962982:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651860.963119:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147568384 00000100:00100000:1.0:1788651860.963129:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147568384 00000100:00100000:1.0:1788651860.963188:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788651860.963198:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147568384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651860.963234:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788651860.963289:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147568384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651860.963297:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788651860.963343:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147568384:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651861.161122:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651861.161208:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651861.161233:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651861.161254:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651861.161297:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125461760 00000100:00100000:3.0:1788651861.161307:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125461760 00000100:00100000:3.0:1788651861.161357:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125462016 00000100:00100000:3.0:1788651861.161360:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125462016 00000100:00100000:3.0:1788651861.161378:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125461888 00000100:00100000:3.0:1788651861.161381:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125461888 00000100:00100000:3.0:1788651861.161398:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 200 00000100:00100000:3.0:1788651861.161406:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125461760:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651861.161479:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff44b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125461760:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 72us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651861.161486:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 200 00000100:00100000:3.0:1788651861.161504:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 201 00000100:00100000:3.0:1788651861.161510:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125462016:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651861.161534:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff448000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125462016:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 25us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651861.161539:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 201 00000100:00100000:3.0:1788651861.161549:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 202 00000100:00100000:3.0:1788651861.161554:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125461888:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651861.161575:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff44bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125461888:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 21us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651861.161588:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 202 00000100:00080000:3.0:1788651861.161609:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651861.161613:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651861.161672:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125461632 00000100:00100000:0.0:1788651861.161677:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125461632 00000100:00100000:0.0:1788651861.161709:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 336 00000100:00100000:0.0:1788651861.161716:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125461632:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651861.161753:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125461632:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 38us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651861.161760:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 336 00000100:00100000:3.0:1788651861.164121:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651861.164225:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125462144 00000100:00100000:1.0:1788651861.164240:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125462144 00000100:00100000:1.0:1788651861.164306:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 203 00000100:00100000:1.0:1788651861.164315:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125462144:12345-192.168.204.45@tcp:400:kworker.0 00000100:00080000:3.0:1788651861.164363:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651861.164382:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff448380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125462144:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 68us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651861.164389:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 203 00000001:02000400:0.0:1788651861.362517:0:13376:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788651861.480313:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651862.496480:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651862.496505:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147568512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651862.496584:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651862.496794:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651862.496970:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651862.496981:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147568640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788651862.497022:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651862.497391:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147568512 00000100:00100000:2.0:1788651862.497400:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147568512 00000100:00100000:2.0:1788651862.497460:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147568640 00000100:00100000:2.0:1788651862.497463:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147568640 00000100:00100000:2.0:1788651862.497480:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788651862.497488:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147568512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651862.497523:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651862.497582:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147568512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651862.497589:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788651862.497605:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788651862.497611:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147568640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651862.497619:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651862.497643:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147568640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651862.497648:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1788651862.497678:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff4b9f80 x1875537147568640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651862.497697:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147568640:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651862.498283:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147568896:0@lo:400:kworker.0 00000100:00100000:1.0:1788651862.498325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651862.498347:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147569408:0@lo:400:kworker.0 00000100:00100000:1.0:1788651862.498368:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651862.498382:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147569920:0@lo:400:kworker.0 00000100:00100000:1.0:1788651862.498400:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651862.498417:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788651862.498422:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147568768:0@lo:400:kworker.0 00000100:00100000:1.0:1788651862.498451:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651862.498472:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147569280:0@lo:400:kworker.0 00000100:00100000:1.0:1788651862.498496:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651862.498511:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147569792:0@lo:400:kworker.0 00000100:00100000:1.0:1788651862.498529:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651862.498703:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147568896 00000100:00100000:2.0:1788651862.498710:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147568896 00000100:00100000:2.0:1788651862.498762:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147569408 00000100:00100000:2.0:1788651862.498765:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147569408 00000100:00100000:2.0:1788651862.498786:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147569920 00000100:00100000:2.0:1788651862.498788:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147569920 00000100:00100000:2.0:1788651862.498804:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788651862.498811:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147568896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.498875:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147568896:12345-0@lo:400:kworker.0 Request processed in 65us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651862.498883:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788651862.498897:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788651862.498903:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147569408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.498959:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147569408:12345-0@lo:400:kworker.0 Request processed in 56us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651862.498975:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788651862.498986:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788651862.498992:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147569920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499021:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147569920:12345-0@lo:400:kworker.0 Request processed in 29us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651862.499027:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788651862.499045:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147569280 00000100:00100000:2.0:1788651862.499049:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147569280 00000100:00100000:2.0:1788651862.499074:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788651862.499080:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147569280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499112:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147569280:12345-0@lo:400:kworker.0 Request processed in 32us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651862.499117:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788651862.499147:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147569280:0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499156:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147568896:0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499166:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147569408:0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499175:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147569920:0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499210:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147569024:0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499237:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651862.499255:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147569536:0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499274:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651862.499289:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147570048:0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499323:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651862.499349:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788651862.499356:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147569152:0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499377:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651862.499387:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147569664:0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499402:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651862.499423:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147569024 00000100:00100000:2.0:1788651862.499426:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147569024 00000100:00100000:2.0:1788651862.499446:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788651862.499451:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147569024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499478:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147569024:12345-0@lo:400:kworker.0 Request processed in 27us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651862.499483:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788651862.499495:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147569536 00000100:00100000:2.0:1788651862.499497:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147569536 00000100:00100000:2.0:1788651862.499510:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147570048 00000100:00100000:2.0:1788651862.499512:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147570048 00000100:00100000:2.0:1788651862.499520:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147569152 00000100:00100000:2.0:1788651862.499522:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147569152 00000100:00100000:2.0:1788651862.499531:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788651862.499536:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147569536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499574:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147569536:12345-0@lo:400:kworker.0 Request processed in 38us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651862.499580:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788651862.499590:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788651862.499596:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147570048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499614:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147570048:12345-0@lo:400:kworker.0 Request processed in 19us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651862.499619:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1788651862.499635:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788651862.499641:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147569152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499667:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147569152:12345-0@lo:400:kworker.0 Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651862.499672:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788651862.499697:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147569152:0@lo:400:kworker.0 00000100:00100000:2.0:1788651862.499706:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147569024:0@lo:400:kworker.0 00010000:00080000:2.0:1788651862.499715:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c310a300 x1875537147569536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651862.499725:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147569536:0@lo:400:kworker.0 00010000:00080000:2.0:1788651862.499733:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c1a37b80 x1875537147570048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651862.499753:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147570048:0@lo:400:kworker.0 00000100:00100000:3.0:1788651862.500660:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147568768 00000100:00100000:3.0:1788651862.500670:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147568768 00000100:00100000:3.0:1788651862.500710:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788651862.500717:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147568768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651862.500838:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147568768:12345-0@lo:400:kworker.0 Request processed in 120us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651862.500845:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:3.0:1788651862.500876:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147569792 00000100:00100000:3.0:1788651862.500880:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147569792 00000100:00100000:3.0:1788651862.500932:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147569664 00000100:00100000:3.0:1788651862.500936:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147569664 00000100:00100000:3.0:1788651862.500958:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788651862.500965:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147569792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651862.500996:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147569792:12345-0@lo:400:kworker.0 Request processed in 32us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651862.501002:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788651862.501013:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788651862.501019:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147569664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651862.501052:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147569664:12345-0@lo:400:kworker.0 Request processed in 34us (1648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651862.501058:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788651862.501193:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147568768:0@lo:400:kworker.0 00010000:00080000:3.0:1788651862.501207:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3731880 x1875537147569792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651862.501218:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147569792:0@lo:400:kworker.0 00010000:00080000:3.0:1788651862.501265:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3730000 x1875537147569664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651878 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651862.501274:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147569664:0@lo:400:kworker.0 00000100:00080000:0.0:1788651862.501588:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788651862.501594:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651862.501596:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651862.501599:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788651862.501624:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff449f80 x1875537147568512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651878 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651862.501642:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff449f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147568512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651863.522440:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651863.522461:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147570176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651863.522526:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651863.522586:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147570176 00000100:00100000:3.0:1788651863.522594:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147570176 00000100:00100000:3.0:1788651863.522636:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788651863.522644:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147570176:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788651863.522673:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651863.522730:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff44aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147570176:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651863.522738:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00010000:00080000:3.0:1788651863.522779:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff449880 x1875537147570176/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651863.522797:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff449880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147570176:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651863.526429:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147570304:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651863.526506:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651863.527237:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651863.527676:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147570304 00000100:00100000:1.0:1788651863.527686:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147570304 00000100:00100000:1.0:1788651863.527751:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788651863.527762:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147570304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651863.527789:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651863.527851:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147570304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (1344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651863.527865:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:1.0:1788651863.527927:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c1a37b80 x1875537147570304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651879 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651863.527948:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147570304:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788651864.544074:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651864.547864:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147570432:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651864.547964:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651864.549991:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147570432 00000100:00100000:2.0:1788651864.550005:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147570432 00000100:00100000:2.0:1788651864.550066:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788651864.550076:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147570432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788651864.551395:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788651864.554731:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff448e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147570432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4647us (6758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651864.554745:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788651864.555408:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147570432:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788651865.568208:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651866.080183:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651866.080208:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c1a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147570560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651866.080302:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651866.080491:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147570560 00000100:00100000:1.0:1788651866.080500:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147570560 00000100:00100000:1.0:1788651866.080558:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788651866.080567:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147570560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651866.080605:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788651866.080659:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147570560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651866.080676:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788651866.080764:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c1a37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147570560:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651866.278861:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651866.278934:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651866.279120:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125462528 00000100:00100000:1.0:1788651866.279130:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125462528 00000100:00100000:1.0:1788651866.279209:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 210 00000100:00100000:1.0:1788651866.279222:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125462528:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651866.279301:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff44ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125462528:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 82us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651866.279310:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 210 00000100:00100000:0.0:1788651866.279612:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125462272 00000100:00100000:0.0:1788651866.279619:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125462272 00000100:00100000:0.0:1788651866.279679:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 338 00000100:00100000:0.0:1788651866.279689:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125462272:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651866.279723:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125462272:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 36us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651866.279729:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 338 00000100:00080000:3.0:1788651866.279823:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651866.284801:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651866.284850:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651866.284885:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651866.284936:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125462784 00000100:00100000:1.0:1788651866.284947:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125462784 00000100:00100000:3.0:1788651866.284948:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125462400 00000100:00100000:3.0:1788651866.284954:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125462400 00000100:00100000:1.0:1788651866.285003:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125462656 00000100:00100000:1.0:1788651866.285006:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125462656 00000100:00100000:0.0:1788651866.285206:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 211 00000100:00100000:0.0:1788651866.285219:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125462784:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651866.285297:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff449f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125462784:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 82us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651866.285306:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 211 00000100:00100000:3.0:1788651866.291770:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 212 00000100:00100000:3.0:1788651866.291788:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125462400:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651866.291859:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff449180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125462400:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 78us (7009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651866.291866:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 212 00000100:00100000:1.0:1788651866.292862:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 213 00000100:00100000:1.0:1788651866.292881:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125462656:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651866.292958:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff448a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125462656:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 87us (8072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651866.292966:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 213 00000100:00080000:0.0:1788651866.296756:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651866.296765:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788651866.598994:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788651867.171893:0:13525:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 19:44:25 (1788651865) === 00000100:00100000:3.0:1788651867.447439:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.448101:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651867.448237:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125463040 00000100:00100000:1.0:1788651867.448248:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125463040 00000100:00100000:1.0:1788651867.448314:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:1.0:1788651867.448326:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:10500:x1875537125463040:12345-192.168.204.45@tcp:700:mkdir.0 00000100:00100000:1.0:1788651867.448425:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:10500:x1875537125463040:12345-192.168.204.45@tcp:700:mkdir.0 Request processed in 102us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651867.448433:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:0.0:1788651867.448619:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125462912 00000100:00100000:0.0:1788651867.448625:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125462912 00000100:00100000:0.0:1788651867.448675:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:0.0:1788651867.448683:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125462912:12345-192.168.204.45@tcp:41:mkdir.0 00000004:00000024:0.0:1788651867.448709:0:6509:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788651867.448785:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125462912:12345-192.168.204.45@tcp:41:mkdir.0 Request processed in 102us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651867.448792:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:1.0:1788651867.457185:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651867.457287:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125463296 00000100:00100000:2.0:1788651867.457297:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125463296 00000100:00100000:2.0:1788651867.457366:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:2.0:1788651867.457376:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:10500:x1875537125463296:12345-192.168.204.45@tcp:36:mkdir.0 00010000:00010000:2.0:1788651867.457434:0:12192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651867.457502:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3c1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b23 expref: 6 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.457519:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651867.457530:0:12192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651867.457612:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c3d7b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.457625:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c3d7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.457635:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c3d7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.457658:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.457666:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.457671:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458255:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458266:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458284:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651867.458300:0:12192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000968dc17f reply state 000000004cb56b9f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458311:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458317:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651867.458320:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651867.458323:0:12192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788651867.458327:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788651867.458335:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c3d7b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458341:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c3d7b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458348:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c3d7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458354:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dca00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651867.458358:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c3d7b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458366:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c3d7b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458373:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:2.0:1788651867.458375:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651867.458386:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c3d7b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458392:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c3d7b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651867.458407:0:12192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000968dc17f reply state 000000004cb56b9f transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458415:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.458421:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f86c3228b00) 00010000:00010000:2.0:1788651867.458423:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651867.458425:0:12192:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788651867.458511:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:10500:x1875537125463296:12345-192.168.204.45@tcp:36:mkdir.0 Request processed in 1134us (1333us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788651867.458519:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:0.0:1788651867.470604:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.470712:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125463424 00000100:00100000:3.0:1788651867.470723:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125463424 00000100:00100000:3.0:1788651867.470871:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:3.0:1788651867.470883:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:10501:x1875537125463424:12345-192.168.204.45@tcp:101:chmod.0 00010000:00010000:3.0:1788651867.470929:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651867.470966:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3d90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33bb6 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.471309:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3d97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.471324:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3d97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.471337:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3d97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651867.471518:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788651867.471523:0:10110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788651867.471564:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3d97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.471591:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3d90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bb6 expref: 9 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.471610:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3d97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bb6 expref: 8 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.471624:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f86e03da300) 00010000:00010000:3.0:1788651867.471627:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651867.471631:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dca00, rc 0) 00000100:00100000:3.0:1788651867.471757:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:10501:x1875537125463424:12345-192.168.204.45@tcp:101:chmod.0 Request processed in 876us (1162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651867.471836:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:0.0:1788651867.475289:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651867.475520:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125463680 00000100:00100000:1.0:1788651867.475531:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125463680 00000100:00100000:1.0:1788651867.476201:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:1.0:1788651867.476215:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:10501:x1875537125463680:12345-192.168.204.45@tcp:36:chmod.0 00010000:00010000:1.0:1788651867.476268:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651867.476297:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3d97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bb6 expref: 8 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.476319:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f86e03da300) 00010000:00010000:1.0:1788651867.476330:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651867.476368:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.476381:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.476410:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651867.476602:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a053cb0 reply state 000000009753a539 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.476614:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.476621:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3372e00) 00010000:00010000:1.0:1788651867.476624:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788651867.476626:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788651867.476633:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788651867.476722:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:10501:x1875537125463680:12345-192.168.204.45@tcp:36:chmod.0 Request processed in 511us (1443us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788651867.476730:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:2.0:1788651867.506323:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651867.506519:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125463808 00000100:00100000:1.0:1788651867.506528:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125463808 00000100:00100000:1.0:1788651867.506580:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:1.0:1788651867.506588:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:10502:x1875537125463808:12345-192.168.204.45@tcp:101:chown.0 00010000:00010000:1.0:1788651867.506610:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651867.506629:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3da5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33bbd expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.506702:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c3dac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.506715:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c3dac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.506743:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c3dac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651867.506785:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788651867.506789:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788651867.506826:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c3dac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.506929:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3da5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bbd expref: 11 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.506948:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c3dac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bbd expref: 10 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.506957:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3372e00) 00010000:00010000:1.0:1788651867.507359:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788651867.507364:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415e00, rc 0) 00000100:00100000:1.0:1788651867.507439:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:10502:x1875537125463808:12345-192.168.204.45@tcp:101:chown.0 Request processed in 850us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651867.507446:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:0.0:1788651867.509324:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.509616:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125463936 00000100:00100000:3.0:1788651867.509625:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125463936 00000100:00100000:3.0:1788651867.509766:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 27 00000100:00100000:3.0:1788651867.509777:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:10502:x1875537125463936:12345-192.168.204.45@tcp:101:chown.0 00010000:00010000:3.0:1788651867.509795:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651867.509814:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3db3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33bc4 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.509879:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3dba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.509893:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3dba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.509938:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3dba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.509951:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3dc1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.509958:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.509974:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510052:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3dc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510061:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510068:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651867.510121:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788651867.510125:0:10110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788651867.510146:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510158:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3dba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510165:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3dba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510176:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3dba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510182:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dd400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651867.510187:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3dba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510194:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3dba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510206:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3372e00) 00010000:00010000:3.0:1788651867.510209:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651867.510213:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3dba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510219:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3dba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510239:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3dc1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510255:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3dc1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510261:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510266:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dd200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651867.510269:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3dc1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510276:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3dc1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510283:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f86c3228b00) 00010000:00010000:3.0:1788651867.510286:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651867.510289:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3dc1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510294:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3dc1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510322:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3db3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bc4 expref: 12 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510499:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bc4 expref: 11 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.510508:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:3.0:1788651867.510511:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651867.510519:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dca00, rc 0) 00000100:00100000:3.0:1788651867.510683:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:10502:x1875537125463936:12345-192.168.204.45@tcp:101:chown.0 Request processed in 907us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651867.510690:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 27 00000100:00100000:0.0:1788651867.513897:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.514170:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125464064 00000100:00100000:3.0:1788651867.514181:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125464064 00000100:00100000:3.0:1788651867.514261:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:3.0:1788651867.514271:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:10502:x1875537125464064:12345-192.168.204.45@tcp:900:chown.0 00000100:00100000:3.0:1788651867.514471:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:10502:x1875537125464064:12345-192.168.204.45@tcp:900:chown.0 Request processed in 201us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651867.514479:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:2.0:1788651867.516535:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651867.516627:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125464320 00000100:00100000:1.0:1788651867.516635:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125464320 00000100:00100000:1.0:1788651867.516729:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:1.0:1788651867.516738:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:10502:x1875537125464320:12345-192.168.204.45@tcp:36:chown.0 00010000:00010000:1.0:1788651867.516801:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651867.516828:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3dc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bc4 expref: 11 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.516867:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:1.0:1788651867.516872:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651867.516896:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.516966:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.516977:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651867.521886:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:3.0:1788651867.522075:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522088:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522097:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522103:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651867.522107:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522117:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522134:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f86c3228b00) 00010000:00010000:3.0:1788651867.522137:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651867.522155:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522162:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3d82 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522183:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522189:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522194:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522199:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651867.522202:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522207:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522215:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:3.0:1788651867.522218:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651867.522221:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522227:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3d89 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522239:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522245:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522258:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522263:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651867.522266:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522273:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522281:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3372e00) 00010000:00010000:3.0:1788651867.522283:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788651867.522287:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.522292:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3d9e lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651867.522739:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004179ecbe reply state 000000009e0d3e2c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.522755:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.522763:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:1.0:1788651867.522770:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788651867.522774:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788651867.522788:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:1.0:1788651867.522876:0:6510:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788651867.522903:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:10502:x1875537125464320:12345-192.168.204.45@tcp:36:chown.0 Request processed in 6162us (6371us total) trans 4294967301 rc 0/0 00010000:00010000:2.0:1788651867.523462:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.523472:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.523478:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.523483:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651867.523487:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.523503:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.523588:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86c3228400) 00000100:00100000:1.0:1788651867.523782:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 28 00010000:00010000:2.0:1788651867.523854:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788651867.523860:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.523867:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3dcf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651867.554315:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651867.555048:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125464448 00000100:00100000:1.0:1788651867.555058:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125464448 00000100:00100000:1.0:1788651867.555119:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:1.0:1788651867.555129:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:10503:x1875537125464448:12345-192.168.204.45@tcp:101:touch.500 00010000:00010000:1.0:1788651867.555165:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651867.555185:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c3dd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33bcb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788651867.556480:0:6511:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1248us 00010000:00010000:3.0:1788651867.572621:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3ddd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.572654:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.572667:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.572683:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3de4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.572690:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.572703:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.572822:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3deb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.572831:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3deb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.572852:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3deb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651867.572883:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788651867.572886:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788651867.573518:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3deb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573531:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3ddd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573538:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3ddd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573545:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3ddd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573551:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dda00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651867.573556:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3ddd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573564:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3ddd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573581:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3372e00) 00010000:00010000:3.0:1788651867.573584:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651867.573589:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3ddd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573596:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3ddd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573609:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3de4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573614:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3de4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573619:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3de4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573624:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dd200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651867.573627:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3de4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573633:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3de4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573652:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f86e03daa00) 00010000:00010000:3.0:1788651867.573655:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651867.573658:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3de4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573663:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3de4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573714:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c3dd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bcb expref: 8 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573728:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3deb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bcb expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.573736:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86e03da700) 00010000:00010000:3.0:1788651867.573738:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788651867.573740:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dd400, rc 0) 00000100:00100000:3.0:1788651867.573829:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:10503:x1875537125464448:12345-192.168.204.45@tcp:101:touch.500 Request processed in 18700us (19524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651867.573838:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:0.0:1788651867.581704:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.581847:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125464704 00000100:00100000:3.0:1788651867.581859:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125464704 00000100:00100000:3.0:1788651867.582138:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 30 00000100:00100000:3.0:1788651867.582150:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:10503:x1875537125464704:12345-192.168.204.45@tcp:101:touch.500 00010000:00010000:3.0:1788651867.582174:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651867.582197:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3df2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33bd2 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.582317:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3df9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.583318:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3df9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.583349:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3df9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.583494:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.583505:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.583513:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788651867.584518:0:10110:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788651867.585164:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c3e07 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.585178:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c3e07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.585187:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c3e07 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.585221:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3df9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.585228:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3df9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.585234:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3df9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.585240:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dca00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651867.585244:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3df9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.585264:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3df9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.585276:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86e03da700) 00010000:00010000:3.0:1788651867.585279:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651867.585284:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3df9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.585291:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3df9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651867.585307:0:10110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042525a45 reply state 000000002a1bbd26 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.585317:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.585323:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff8f86e03da900) 00010000:00010000:3.0:1788651867.585326:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788651867.585329:0:10110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788651867.586288:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3df2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bd2 expref: 10 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.586308:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c3e07 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bd2 expref: 9 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.586316:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f86e03da300) 00010000:00010000:3.0:1788651867.586319:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651867.586322:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502a00, rc 0) 00000100:00100000:3.0:1788651867.586565:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:10503:x1875537125464704:12345-192.168.204.45@tcp:101:touch.500 Request processed in 4415us (4871us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788651867.586574:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 30 00000100:00100000:2.0:1788651867.594238:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651867.594820:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125464960 00000100:00100000:1.0:1788651867.594831:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125464960 00000100:00100000:1.0:1788651867.595278:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:1.0:1788651867.595289:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:10503:x1875537125464960:12345-192.168.204.45@tcp:36:touch.500 00010000:00010000:1.0:1788651867.595351:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651867.595381:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c3e07 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bd2 expref: 10 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.595400:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f86e03da300) 00010000:00010000:1.0:1788651867.595410:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651867.595477:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.595491:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.595501:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651867.595601:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb3ea0e5 reply state 00000000e1fa6efb transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.595614:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.595635:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f85c3372400) 00010000:00010000:1.0:1788651867.595648:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788651867.595652:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788651867.595748:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:10503:x1875537125464960:12345-192.168.204.45@tcp:36:touch.500 Request processed in 460us (1519us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788651867.595765:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:0.0:1788651867.600413:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.600692:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125465088 00000100:00100000:3.0:1788651867.600704:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125465088 00000100:00100000:3.0:1788651867.600768:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 32 00000100:00100000:3.0:1788651867.600778:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:10503:x1875537125465088:12345-192.168.204.45@tcp:101:touch.500 00010000:00010000:3.0:1788651867.600800:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651867.600823:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3e1c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33bd9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.600893:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3e1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bd9 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.601181:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3e1c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bd9 expref: 12 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.601202:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f85c3372400) 00010000:00010000:3.0:1788651867.601205:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651867.601209:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dc400, rc 0) 00000100:00100000:3.0:1788651867.601271:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+12:10503:x1875537125465088:12345-192.168.204.45@tcp:101:touch.500 Request processed in 495us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651867.601278:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 32 00000100:00100000:0.0:1788651867.604164:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.604959:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125465216 00000100:00100000:3.0:1788651867.604970:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125465216 00000100:00100000:3.0:1788651867.605018:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:3.0:1788651867.605026:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2387:x1875537125465216:12345-192.168.204.45@tcp:8:touch.500 00010000:00080000:3.0:1788651867.605078:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp t0 exp 0000000000000000 cur 323 last 0 00000020:00000080:3.0:1788651867.605107:0:8429:0:(genops.c:1385:class_connect()) connect: client 72121fb7-fb91-4477-92d5-4e7fe3e6b65d, cookie 0xcd2f56ea038c3e23 00002000:00100000:3.0:1788651867.605119:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 72121fb7-fb91-4477-92d5-4e7fe3e6b65d/ffff8f86ff46b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788651867.605135:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788651867.605213:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788651867.605242:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8f86ff469000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788651867.605310:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2387:x1875537125465216:12345-192.168.204.45@tcp:8:touch.500 Request processed in 283us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651867.605319:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:1.0:1788651867.609164:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.609356:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125465344 00000100:00100000:3.0:1788651867.609367:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125465344 00000100:00100000:3.0:1788651867.609440:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:3.0:1788651867.609452:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:0:x1875537125465344:12345-192.168.204.45@tcp:2:touch.500 00000100:00080000:0.0:1788651867.609766:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651867.616324:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147570688:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.616399:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651867.616476:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147570688 00000100:00100000:0.0:1788651867.616483:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147570688 00000100:00100000:0.0:1788651867.616526:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788651867.616535:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147570688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.616586:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147570688:12345-0@lo:400:kworker.0 Request processed in 51us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651867.616608:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788651867.616670:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147570688:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.616715:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147570816:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.616743:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651867.616800:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147570944:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.616826:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651867.616885:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147570944 00000100:00100000:0.0:1788651867.616889:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147570944 00000100:00100000:0.0:1788651867.617675:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788651867.617687:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147570944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.617742:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147570944:12345-0@lo:400:kworker.0 Request processed in 58us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651867.617750:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788651867.617792:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147570944:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.617833:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147571072:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.617862:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651867.617892:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147570816 00000100:00100000:0.0:1788651867.617897:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147570816 00000100:00100000:0.0:1788651867.617951:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147571072 00000100:00100000:0.0:1788651867.617955:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147571072 00000100:00100000:0.0:1788651867.617973:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788651867.617980:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147570816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.618018:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147570816:12345-0@lo:400:kworker.0 Request processed in 38us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651867.618024:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788651867.618036:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788651867.618042:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147571072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.618072:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147571072:12345-0@lo:400:kworker.0 Request processed in 30us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651867.618078:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788651867.618102:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147571072:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.618122:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147570816:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.618172:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147571200:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.618198:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651867.618226:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147571200 00000100:00100000:0.0:1788651867.618230:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147571200 00000100:00100000:0.0:1788651867.618252:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788651867.618259:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147571200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.618292:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147571200:12345-0@lo:400:kworker.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651867.618298:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788651867.618326:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147571200:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.618355:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147571328:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.618378:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651867.618417:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147571456:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.618439:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651867.618465:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147571328 00000100:00100000:0.0:1788651867.618468:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147571328 00000100:00100000:0.0:1788651867.618494:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147571456 00000100:00100000:0.0:1788651867.618498:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147571456 00000100:00100000:0.0:1788651867.618510:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788651867.618516:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147571328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.618547:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147571328:12345-0@lo:400:kworker.0 Request processed in 32us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651867.618553:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788651867.618565:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788651867.618571:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147571456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.618631:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147571456:12345-0@lo:400:kworker.0 Request processed in 58us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651867.618897:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147571584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651867.618941:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788651867.619861:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651867.619867:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651867.619930:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147571712:0@lo:400:kworker.0 00000100:00100000:3.0:1788651867.619965:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651867.620025:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147572096:0@lo:400:kworker.0 00000100:00100000:3.0:1788651867.620050:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651867.620081:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147572096 00000100:00100000:3.0:1788651867.620087:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147572096 00000100:00100000:0.0:1788651867.620240:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788651867.620429:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147571712 00000100:00100000:0.0:1788651867.620434:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147571712 00000100:00100000:0.0:1788651867.620811:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788651867.620822:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147571712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.620901:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147571712:12345-0@lo:400:kworker.0 Request processed in 82us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651867.620929:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788651867.620983:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147571840:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.621013:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651867.621054:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147571328:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.621073:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651867.621079:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147571968:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.621103:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788651867.621144:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff49e300 x1875537147571456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651867.621155:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147571456:0@lo:400:kworker.0 00010000:00080000:0.0:1788651867.621181:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff446680 x1875537147571712/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651867.621190:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147571712:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.621209:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147571840 00000100:00100000:0.0:1788651867.621214:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147571840 00000100:00100000:0.0:1788651867.621249:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788651867.621256:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147571840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.621291:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147571840:12345-0@lo:400:kworker.0 Request processed in 35us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651867.621297:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1788651867.621321:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c2a00 x1875537147571840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651867.621329:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147571840:0@lo:400:kworker.0 00010000:00010000:1.0:1788651867.621865:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651867.621884:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147571584 00000100:00100000:1.0:1788651867.621890:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147571584 00000100:00100000:1.0:1788651867.621953:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788651867.621961:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147571584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651867.621980:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651867.622028:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147571584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (3085us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651867.622034:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:1.0:1788651867.622066:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff447100 x1875537147571584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651867.622083:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147571584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651867.622103:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147571968 00000100:00100000:1.0:1788651867.622106:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147571968 00000100:00080000:3.0:1788651867.622365:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651867.622371:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651867.622384:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651867.622386:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651867.622400:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788651867.622409:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147572096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651867.622458:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147572096:12345-0@lo:400:kworker.0 Request processed in 39us (2395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651867.622465:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788651867.622591:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147572352:0@lo:400:kworker.0 00000100:00100000:0.0:1788651867.622633:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651867.622684:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147572224:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788651867.622708:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651867.622944:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147572352 00000100:00100000:3.0:1788651867.622950:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147572352 00000100:00100000:3.0:1788651867.622989:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788651867.622996:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147572352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651867.623030:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147572352:12345-0@lo:400:kworker.0 Request processed in 35us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651867.623036:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1788651867.623096:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788651867.623116:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff4b9c00 x1875537147572352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651867.623127:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147572352:0@lo:400:kworker.0 00000100:00100000:2.0:1788651867.623196:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147572224 00000100:00100000:2.0:1788651867.623201:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147572224 00000100:00100000:2.0:1788651867.623232:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788651867.623239:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147572224:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651867.623253:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651867.623298:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147572224:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651867.623304:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1788651867.623403:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff4ba680 x1875537147572224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651883 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651867.623415:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147572224:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788651867.623585:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c1c00 x1875537147572096/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651883 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651867.623668:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147572096:0@lo:400:kworker.0 00000100:00100000:1.0:1788651867.623774:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788651867.623784:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147571968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651867.623839:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147571968:12345-0@lo:400:kworker.0 Request processed in 59us (2734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651867.623854:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788651867.623935:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147571968:0@lo:400:kworker.0 00000001:00080000:2.0:1788651867.627705:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:2.0:1788651867.627722:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000100:00100000:3.0:1788651867.628140:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:0:x1875537125465344:12345-192.168.204.45@tcp:2:touch.500 Request processed in 18685us (18982us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788651867.628153:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:1.0:1788651867.637672:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.638080:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125465600 00000100:00100000:3.0:1788651867.638093:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125465600 00000100:00100000:3.0:1788651867.638160:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:3.0:1788651867.638172:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+12:10503:x1875537125465600:12345-192.168.204.45@tcp:35:touch.500 00000100:00100000:3.0:1788651867.638489:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:10503:x1875537125465600:12345-192.168.204.45@tcp:35:touch.500 Request processed in 319us (826us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788651867.638516:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:0.0:1788651867.671473:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.671559:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125465728 00000100:00100000:3.0:1788651867.671570:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125465728 00000100:00100000:3.0:1788651867.671628:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:3.0:1788651867.671652:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:10504:x1875537125465728:12345-192.168.204.45@tcp:101:rm.0 00010000:00010000:3.0:1788651867.671675:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651867.671695:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3e2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33be0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.671772:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3e31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.671787:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3e31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.671799:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3e31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651867.671854:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788651867.671858:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788651867.671897:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3e31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.672153:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3e2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33be0 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.672175:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3e31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33be0 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.672206:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86e03da700) 00010000:00010000:3.0:1788651867.672209:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651867.672212:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dd200, rc 0) 00000100:00100000:3.0:1788651867.672322:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:10504:x1875537125465728:12345-192.168.204.45@tcp:101:rm.0 Request processed in 684us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651867.672329:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:1.0:1788651867.682783:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.682883:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125465984 00000100:00100000:3.0:1788651867.682894:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125465984 00000100:00100000:2.0:1788651867.685764:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:2.0:1788651867.685782:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:10504:x1875537125465984:12345-192.168.204.45@tcp:101:rm.0 00010000:00010000:2.0:1788651867.685803:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651867.685838:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c3e38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33be7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651867.685968:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788651867.686076:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c3e38 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33be7 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.686091:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3372e00) 00010000:00010000:2.0:1788651867.686094:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651867.686100:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c3e38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33be7 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.686114:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd400, rc 0) 00000100:00100000:2.0:1788651867.686189:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:10504:x1875537125465984:12345-192.168.204.45@tcp:101:rm.0 Request processed in 414us (3417us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788651867.686197:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:1.0:1788651867.690753:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.690842:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125466112 00000100:00100000:3.0:1788651867.690852:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125466112 00000100:00100000:3.0:1788651867.690947:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:3.0:1788651867.690968:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:10504:x1875537125466112:12345-192.168.204.45@tcp:37:rm.0 00000100:00100000:1.0:1788651867.697658:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:10504:x1875537125466112:12345-192.168.204.45@tcp:37:rm.0 Request processed in 6673us (6896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651867.697674:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:1.0:1788651867.708158:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651867.708249:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125466368 00000100:00100000:2.0:1788651867.708259:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125466368 00000100:00100000:2.0:1788651867.708314:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:2.0:1788651867.708324:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:10504:x1875537125466368:12345-192.168.204.45@tcp:35:rm.0 00000100:00100000:2.0:1788651867.708539:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6ee050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:10504:x1875537125466368:12345-192.168.204.45@tcp:35:rm.0 Request processed in 215us (391us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788651867.708547:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:0.0:1788651867.714884:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651867.715031:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125466624 00000100:00100000:1.0:1788651867.715041:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125466624 00000100:00100000:1.0:1788651867.715099:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 35 00000100:00100000:1.0:1788651867.715110:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:10504:x1875537125466624:12345-192.168.204.45@tcp:101:rm.0 00010000:00010000:1.0:1788651867.715133:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651867.715153:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3e46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33bee expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.715256:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3e4d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.715272:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3e4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.715284:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3e4d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651867.715295:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788651867.715396:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c3e46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bee expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.715414:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3e4d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bee expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651867.715431:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86e03da700) 00010000:00010000:1.0:1788651867.715434:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788651867.715438:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414e00, rc 0) 00000100:00100000:1.0:1788651867.715750:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:10504:x1875537125466624:12345-192.168.204.45@tcp:101:rm.0 Request processed in 640us (876us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788651867.715758:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 35 00000100:00100000:3.0:1788651867.718315:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651867.718425:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125466752 00000100:00100000:0.0:1788651867.718437:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125466752 00000100:00100000:0.0:1788651867.718507:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 36 00000100:00100000:0.0:1788651867.718516:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:10504:x1875537125466752:12345-192.168.204.45@tcp:41:rm.0 00000004:00000024:0.0:1788651867.718582:0:10110:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:0.0:1788651867.718663:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:10504:x1875537125466752:12345-192.168.204.45@tcp:41:rm.0 Request processed in 147us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651867.718671:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 36 00000100:00100000:2.0:1788651867.721633:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651867.721944:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125466880 00000100:00100000:3.0:1788651867.721963:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125466880 00000100:00100000:3.0:1788651867.722012:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 37 00000100:00100000:3.0:1788651867.722022:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:10504:x1875537125466880:12345-192.168.204.45@tcp:101:rm.0 00010000:00010000:3.0:1788651867.722044:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651867.722064:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3e5b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33bf5 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722127:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3e62 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722141:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3e62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722171:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3e62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722185:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c3e69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722193:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c3e69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722199:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c3e69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722277:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031200/0xcd2f56ea038c3e70 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722286:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031200/0xcd2f56ea038c3e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722293:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031200/0xcd2f56ea038c3e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651867.722326:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788651867.722330:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788651867.722348:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031200/0xcd2f56ea038c3e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722359:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031200/0xcd2f56ea038c3e70 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722367:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3e62 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722383:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3e62 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722390:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3e62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722396:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dda00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651867.722400:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3e62 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722408:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3e62 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722420:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86e03da700) 00010000:00010000:3.0:1788651867.722423:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651867.722428:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3e62 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.722434:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3e62 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.724248:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c3e69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.724263:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c3e69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.724270:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c3e69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.724276:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651867.724295:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c3e69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.724305:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c3e69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.724318:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff8f86e03da900) 00010000:00010000:3.0:1788651867.724321:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651867.724325:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c3e69 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.724331:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c3e69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.724374:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3e5b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bf5 expref: 20 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.724390:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031200/0xcd2f56ea038c3e70 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bf5 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651867.724397:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f85c3372400) 00010000:00010000:3.0:1788651867.724399:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651867.724402:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0031200, rc 0) 00000100:00100000:3.0:1788651867.724488:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:10504:x1875537125466880:12345-192.168.204.45@tcp:101:rm.0 Request processed in 2467us (2864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651867.724497:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 37 00000100:00100000:1.0:1788651867.727874:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651867.728037:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125467136 00000100:00100000:2.0:1788651867.728047:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125467136 00000100:00100000:2.0:1788651867.728095:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 38 00000100:00100000:2.0:1788651867.728105:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:10504:x1875537125467136:12345-192.168.204.45@tcp:36:rm.0 00010000:00010000:2.0:1788651867.728188:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788651867.728215:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031200/0xcd2f56ea038c3e70 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bf5 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728237:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3e1c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bd9 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728250:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f85c3372400) 00010000:00010000:2.0:1788651867.728260:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3e31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33be0 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728271:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86e03da700) 00010000:00010000:2.0:1788651867.728275:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651867.728297:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e77 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728309:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e77 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728319:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e77 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728329:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728336:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728343:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728437:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e85 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728446:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728624:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788651867.728849:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788651867.728859:0:6510:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 323663950250ns, next at 324663947963ns, rc = 0 00010000:00010000:2.0:1788651867.728900:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3e8c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728932:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3e8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.728940:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3e8c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729146:0:6510:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3e8c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729154:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3e8c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729160:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3e8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729183:0:6510:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651867.729201:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e85 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729215:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e85 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729221:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729227:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651867.729231:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e85 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729239:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e85 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729249:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f85c3372400) 00010000:00010000:2.0:1788651867.729251:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788651867.729255:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e85 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729261:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e85 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729277:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e77 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729284:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e77 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729290:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e77 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729295:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651867.729306:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e77 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729312:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e77 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729320:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86e03da700) 00010000:00010000:2.0:1788651867.729322:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651867.729325:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e77 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729330:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e77 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651867.729341:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea8149c8 reply state 00000000b7429c71 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729352:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.729359:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff8f86e03da900) 00010000:00010000:2.0:1788651867.729361:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651867.729364:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651867.729456:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:10504:x1875537125467136:12345-192.168.204.45@tcp:36:rm.0 Request processed in 1340us (1579us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788651867.729463:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 38 00010000:00010000:0.0:1788651867.730240:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651867.730249:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3e8c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651867.730256:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dde00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788651867.730259:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3e8c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651867.730267:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3e8c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651867.730279:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f85c3372400) 00010000:00010000:0.0:1788651867.730281:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788651867.730285:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3e8c lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651867.730291:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3e8c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651867.730305:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651867.730307:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651867.730309:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651867.735033:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651867.735321:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125467392 00000100:00100000:2.0:1788651867.735331:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125467392 00000100:00100000:2.0:1788651867.735388:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:2.0:1788651867.735399:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:10504:x1875537125467392:12345-192.168.204.45@tcp:35:rm.0 00000100:00100000:2.0:1788651867.735628:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:10504:x1875537125467392:12345-192.168.204.45@tcp:35:rm.0 Request processed in 231us (612us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788651867.735663:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:1.0:1788651867.740324:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651867.740422:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125467648 00000100:00100000:2.0:1788651867.740435:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125467648 00000100:00100000:2.0:1788651867.740504:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 39 00000100:00100000:2.0:1788651867.740514:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:10504:x1875537125467648:12345-192.168.204.45@tcp:36:rm.0 00010000:00010000:2.0:1788651867.740579:0:12192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788651867.740619:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c3e4d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bee expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.740653:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3deb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bcb expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.740669:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f86e03da700) 00010000:00010000:2.0:1788651867.740686:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c3dac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bbd expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.740693:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3372e00) 00010000:00010000:2.0:1788651867.740699:0:12192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651867.740723:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e93 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.740736:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.740757:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.740769:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.740790:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.740797:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.740881:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3ea1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.740889:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3ea1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.740895:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3ea1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651867.741213:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788651867.741230:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3ea1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741238:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3ea1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741245:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3ea1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741251:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dde00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651867.741256:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3ea1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741264:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3ea1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741283:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff8f85c2857700) 00010000:00010000:2.0:1788651867.741285:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788651867.741289:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3ea1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741295:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c3ea1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741314:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741321:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e93 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741327:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741332:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651867.741335:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741341:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e93 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741348:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857c00) 00010000:00010000:2.0:1788651867.741351:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651867.741353:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e93 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741359:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c3e93 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651867.741381:0:12192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9a9a96f reply state 00000000d22b064d transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741391:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651867.741397:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f85c2857b00) 00010000:00010000:2.0:1788651867.741400:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651867.741402:0:12192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651867.741492:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:10504:x1875537125467648:12345-192.168.204.45@tcp:36:rm.0 Request processed in 978us (1177us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788651867.741499:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 39 00000100:00100000:3.0:1788651868.640171:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651868.640193:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147572480:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651868.640259:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651868.640345:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147572480 00000100:00100000:3.0:1788651868.640354:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147572480 00000100:00100000:3.0:1788651868.640402:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788651868.640411:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147572480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788651868.640440:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651868.640482:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147572480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651868.640489:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:3.0:1788651868.640530:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c3800 x1875537147572480/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651868.640549:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147572480:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651868.641000:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147572608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651868.641035:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651868.641317:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651868.641333:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147572608 00000100:00100000:3.0:1788651868.641338:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147572608 00000100:00100000:3.0:1788651868.641376:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788651868.641384:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147572608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651868.641398:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651868.642680:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147572608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1292us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651868.642690:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00010000:00080000:1.0:1788651868.643375:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d0e00 x1875537147572608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651884 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651868.643399:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147572608:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788651869.664305:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651869.665718:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147572736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651869.665807:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651869.666197:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147572736 00000100:00100000:3.0:1788651869.666205:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147572736 00000100:00100000:3.0:1788651869.666253:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788651869.666263:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147572736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651869.666319:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651869.666386:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147572736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651869.666393:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788651869.666455:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147572736:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788651870.688053:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651871.205180:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651871.205205:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147572864:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651871.205276:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651871.206049:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147572864 00000100:00100000:1.0:1788651871.206060:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147572864 00000100:00100000:1.0:1788651871.206112:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788651871.206122:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147572864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651871.206153:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788651871.206210:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147572864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651871.206217:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788651871.206288:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147572864:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788651871.396615:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651871.396676:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651871.396703:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651871.396733:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651871.396754:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651871.396778:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651871.396805:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125467904 00000100:00100000:1.0:1788651871.396815:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125467904 00000100:00100000:1.0:1788651871.396869:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125468416 00000100:00100000:1.0:1788651871.396872:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125468416 00000100:00100000:1.0:1788651871.396899:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125468032 00000100:00100000:1.0:1788651871.396902:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125468032 00000100:00100000:1.0:1788651871.396941:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125468288 00000100:00100000:1.0:1788651871.396944:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125468288 00000100:00100000:1.0:1788651871.396959:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 220 00000100:00100000:1.0:1788651871.396968:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:2391:x1875537125467904:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651871.397066:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:2391:x1875537125467904:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 97us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651871.397073:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 220 00000100:00100000:1.0:1788651871.397090:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 221 00000100:00100000:1.0:1788651871.397096:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125468416:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651871.397120:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125468416:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 25us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651871.397126:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 221 00000100:00100000:1.0:1788651871.397137:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 222 00000100:00100000:1.0:1788651871.397142:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125468032:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651871.397162:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125468032:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 20us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651871.397177:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 222 00000100:00100000:1.0:1788651871.397187:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 223 00000100:00100000:1.0:1788651871.397198:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125468288:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651871.397220:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125468288:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651871.397226:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 223 00000100:00100000:1.0:1788651871.397245:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125467776 00000100:00100000:1.0:1788651871.397248:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125467776 00000100:00100000:1.0:1788651871.397275:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 340 00000100:00100000:1.0:1788651871.397280:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125467776:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651871.397300:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125467776:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 21us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651871.397306:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 340 00000100:00080000:1.0:1788651871.397336:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788651871.397340:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651871.399408:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125468160 00000100:00100000:2.0:1788651871.399423:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125468160 00000100:00100000:2.0:1788651871.399553:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 82 00000100:00100000:2.0:1788651871.399574:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125468160:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651871.399654:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125468160:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 93us (2978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651871.399662:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 82 00000100:00080000:1.0:1788651871.400437:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788651871.712105:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788651871.851657:0:13673:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:3.0:1788651872.736355:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147572992:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.736641:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.736694:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147573504:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.736721:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.736739:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147574016:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.736758:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.736772:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147574528:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.736788:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.736806:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788651872.736812:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147573376:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.736830:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.736844:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147573888:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.736859:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.736873:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147574400:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.736889:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.736937:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147573120:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.736957:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.736972:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147573632:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.736999:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.737017:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147574144:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.737043:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.737103:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788651872.737109:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147573248:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.737129:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.737143:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147573760:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.737358:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.737380:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147574272:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.737403:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.738336:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147573504 00000100:00100000:3.0:1788651872.738347:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147573504 00000100:00100000:3.0:1788651872.738399:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147573248 00000100:00100000:3.0:1788651872.738403:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147573248 00000100:00100000:3.0:1788651872.742236:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788651872.742273:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147573504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.742406:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147573504:12345-0@lo:400:kworker.0 Request processed in 151us (5683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.742415:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788651872.742508:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788651872.742517:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147573248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.742568:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147573248:12345-0@lo:400:kworker.0 Request processed in 53us (5438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.742574:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788651872.742602:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147574016 00000100:00100000:3.0:1788651872.742610:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147574016 00000100:00100000:3.0:1788651872.742676:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147574528 00000100:00100000:3.0:1788651872.742679:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147574528 00000100:00100000:3.0:1788651872.742692:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147573888 00000100:00100000:3.0:1788651872.742694:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147573888 00000100:00100000:3.0:1788651872.742707:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147574400 00000100:00100000:3.0:1788651872.742710:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147574400 00000100:00100000:3.0:1788651872.742725:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788651872.742732:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147574016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.742764:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147574016:12345-0@lo:400:kworker.0 Request processed in 33us (6005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.742771:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788651872.742783:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788651872.742788:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147574528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.742817:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147574528:12345-0@lo:400:kworker.0 Request processed in 29us (6028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.742823:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788651872.742833:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788651872.742839:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147573888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.742865:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147573888:12345-0@lo:400:kworker.0 Request processed in 27us (6004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.742871:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788651872.742881:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788651872.742887:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147574400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.742935:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147574400:12345-0@lo:400:kworker.0 Request processed in 49us (6044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.742942:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788651872.742965:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147573376 00000100:00100000:3.0:1788651872.742976:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147573376 00000100:00100000:3.0:1788651872.742997:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147573120 00000100:00100000:3.0:1788651872.743000:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147573120 00000100:00100000:3.0:1788651872.743010:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147573632 00000100:00100000:3.0:1788651872.743013:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147573632 00000100:00100000:3.0:1788651872.743025:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147574144 00000100:00100000:3.0:1788651872.743028:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147574144 00000100:00100000:3.0:1788651872.743040:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147573760 00000100:00100000:3.0:1788651872.743043:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147573760 00000100:00100000:3.0:1788651872.743054:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147574272 00000100:00100000:3.0:1788651872.743056:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147574272 00000100:00100000:3.0:1788651872.743070:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788651872.743076:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147573376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.743109:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147573376:12345-0@lo:400:kworker.0 Request processed in 33us (6277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.743115:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788651872.743126:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788651872.743131:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147573120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651872.743312:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147572992 00000100:00100000:1.0:1788651872.743317:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147572992 00000100:00100000:1.0:1788651872.743351:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1788651872.743358:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147572992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651872.743392:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147572992:12345-0@lo:400:kworker.0 Request processed in 35us (6752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651872.743398:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00010000:0.0:1788651872.743740:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788651872.743943:0:9838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328679034120ns, next at 329679031337ns, rc = 0 00000100:00100000:0.0:1788651872.744403:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788651872.744431:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147574656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651872.744479:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651872.744771:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147573120:12345-0@lo:400:kworker.0 Request processed in 26us (6199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.744781:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788651872.744804:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788651872.744814:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147573632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.744857:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147573632:12345-0@lo:400:kworker.0 Request processed in 47us (7857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.744862:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788651872.744873:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788651872.744878:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147574144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.744944:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147574144:12345-0@lo:400:kworker.0 Request processed in 66us (7900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.744950:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788651872.744963:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788651872.744969:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147573760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.744996:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147573760:12345-0@lo:400:kworker.0 Request processed in 28us (7638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.745002:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788651872.745012:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788651872.745019:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147574272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.745048:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147574272:12345-0@lo:400:kworker.0 Request processed in 30us (7644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651872.745053:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:3.0:1788651872.745112:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651872.745119:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651872.745123:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651872.745126:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651872.745748:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147574656 00000100:00100000:0.0:1788651872.745755:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147574656 00000100:00100000:0.0:1788651872.745805:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788651872.745813:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147574656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651872.745838:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651872.745886:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147574656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (1406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651872.745892:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788651872.745965:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147574784:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788651872.745999:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788651872.746031:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff4b8a80 x1875537147574656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651872.746053:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147574656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651872.746078:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147574784 00000100:00100000:0.0:1788651872.746082:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147574784 00000100:00100000:0.0:1788651872.746098:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788651872.746103:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147574784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788651872.746113:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651872.746142:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147574784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651872.746148:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788651872.746359:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147573248:0@lo:400:kworker.0 00010000:00080000:3.0:1788651872.746379:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c37c4000 x1875537147573760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651872.746388:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147573760:0@lo:400:kworker.0 00010000:00080000:3.0:1788651872.746401:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c37c5880 x1875537147574272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651872.746408:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147574272:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.746591:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147573120:0@lo:400:kworker.0 00010000:00080000:0.0:1788651872.746641:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff51e680 x1875537147574784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651888 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651872.746654:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147574784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651872.746814:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147573632:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.746825:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147574144:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.746866:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147573376:0@lo:400:kworker.0 00010000:00080000:3.0:1788651872.746881:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c37c7b80 x1875537147573888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651872.746890:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147573888:0@lo:400:kworker.0 00010000:00080000:3.0:1788651872.746901:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c37c6a00 x1875537147574400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651872.747263:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147574400:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.747279:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147572992:0@lo:400:kworker.0 00000100:00100000:3.0:1788651872.747291:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147573504:0@lo:400:kworker.0 00010000:00080000:3.0:1788651872.747302:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c37c4380 x1875537147574016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651872.747310:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147574016:0@lo:400:kworker.0 00010000:00080000:3.0:1788651872.747320:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c37c4e00 x1875537147574528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651888 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651872.747327:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147574528:0@lo:400:kworker.0 00000004:00080000:3.0:1788651872.758536:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788651872.758591:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:3.0:1788651872.758611:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788651872.758982:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.758995:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759003:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759010:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651872.759015:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759023:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759042:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff8f86e03da900) 00000100:00100000:3.0:1788651872.759046:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147574912:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788651872.759047:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651872.759055:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759064:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c3e00 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759082:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759089:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759105:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759111:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651872.759115:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651872.759122:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651872.759127:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759136:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff8f85c3372400) 00010000:00010000:0.0:1788651872.759140:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651872.759143:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759149:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c3e15 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759186:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759193:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759198:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651872.759200:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147574912 00010000:00010000:0.0:1788651872.759203:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651872.759206:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651872.759207:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147574912 00010000:00010000:0.0:1788651872.759222:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759230:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x85a08693 (ffff8f86e03da900) 00010000:00010000:0.0:1788651872.759232:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651872.759235:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759241:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3e7e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x85a08693 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759255:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759262:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651872.759265:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788651872.759268:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759273:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd000 already unused, calling callback (ffffffffc1aad4f0) 00000100:00100000:2.0:1788651872.759277:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147574912:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788651872.759277:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759283:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759291:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8f85c2857b00) 00010000:00010000:0.0:1788651872.759294:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651872.759296:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788651872.759303:0:8744:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00010000:00010000:0.0:1788651872.759307:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c3e9a lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651872.759337:0:8744:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ca95b, atime: 0x6a9ca95b, ctime: 0x6a9ca95b, blocks: 0x0 00010000:00010000:2.0:1788651872.759344:0:8744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005882b7fd/0xcd2f56ea038c3ea8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651872.759483:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1788651872.759489:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651872.759496:0:8744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005882b7fd/0xcd2f56ea038c3ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651872.759515:0:8744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005882b7fd/0xcd2f56ea038c3ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651872.759524:0:8744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005882b7fd/0xcd2f56ea038c3ea8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651872.759531:0:8744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005882b7fd/0xcd2f56ea038c3ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651872.759561:0:8744:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651872.759585:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651872.759591:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005882b7fd/0xcd2f56ea038c3ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759598:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788651872.759601:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005882b7fd/0xcd2f56ea038c3ea8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759608:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005882b7fd/0xcd2f56ea038c3ea8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759622:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005882b7fd/0xcd2f56ea038c3ea8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759628:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005882b7fd/0xcd2f56ea038c3ea8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651872.759644:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651872.759645:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651872.759647:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651872.759711:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3637:x1875537147574912:12345-0@lo:6:osp-syn-1-0.0 Request processed in 437us (592us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788651872.759718:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:3.0:1788651872.759776:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f86ff4b9180/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788651872.759782:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147574912:0@lo:6:osp-syn-1-0.0 00000020:00000080:2.0:1788651873.040206:0:13721:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedabdbe10 20000000:00000080:2.0:1788651873.040224:0:13721:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f86ff499000 uarg=0000000000000000 20000000:01000000:2.0:1788651873.040340:0:13721:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788651873.040347:0:13721:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1788651873.040353:0:13721:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788651873.040812:0:13722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788651873.041180:0:13721:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788651873.047173:0:13721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788651873.047208:0:13721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788651873.047225:0:13721:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788651873.047240:0:13721:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788651873.047259:0:13721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.047277:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c3d35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ba8 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.047285:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3d3c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33baf expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.047294:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c3d4a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d43 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.047301:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3d58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d51 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.047307:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d5f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.047313:0:13721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86c29dc200/0xcd2f56ea038c3d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3d6d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.047336:0:13721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.047382:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c29dc200/0xcd2f56ea038c3d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3d6d expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.047401:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86c29dc200/0xcd2f56ea038c3d74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d6d expref: 23 pid: 6505 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651873.047416:0:13721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3681c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575040:0@lo:104: 00000100:00100000:3.0:1788651873.047490:0:13721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651873.047570:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3d5f expref: 23 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.047579:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3d66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d5f expref: 23 pid: 6505 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651873.047587:0:13721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3680700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575168:0@lo:104: 00000100:00100000:0.0:1788651873.047590:0:6493:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788651873.047602:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147575040 00000100:00100000:3.0:1788651873.047607:0:13721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651873.047608:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147575040 00000100:00100000:0.0:1788651873.047654:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147575168 00000100:00100000:0.0:1788651873.047665:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147575168 00000100:00100000:0.0:1788651873.047683:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788651873.047692:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c342dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:13721:x1875537147575040:12345-0@lo:104: 00010000:00010000:0.0:1788651873.047704:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.047755:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788651873.047761:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c342dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+4:13721:x1875537147575040:12345-0@lo:104: Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651873.047768:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788651873.047813:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788651873.047820:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:13721:x1875537147575168:12345-0@lo:104: 00010000:00010000:0.0:1788651873.047827:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.047873:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788651873.047878:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:13721:x1875537147575168:12345-0@lo:104: Request processed in 60us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651873.047884:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788651873.047901:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788651873.047931:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.047938:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651873.047942:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.047959:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651873.047981:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651873.047986:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788651873.048012:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.048018:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651873.048040:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.048048:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5400/0xcd2f56ea038c3d6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d74 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.048060:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651873.048064:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.048069:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651873.048072:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.048078:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651873.048085:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651873.048090:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788651873.048111:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.048117:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651873.048132:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.048139:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86ff415000/0xcd2f56ea038c3d5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d66 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.048149:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651873.048151:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651873.048153:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651873.048159:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651873.048171:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147575424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651873.048201:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651873.048246:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147575552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651873.048270:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651873.048302:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147575424 00000100:00100000:0.0:1788651873.048306:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147575424 00010000:00010000:0.0:1788651873.048324:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c29dc200/0xcd2f56ea038c3d74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d6d expref: 24 pid: 6505 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651873.048383:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147575552 00000100:00100000:0.0:1788651873.048387:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147575552 00010000:00010000:0.0:1788651873.048400:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3d66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d5f expref: 25 pid: 6505 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651873.048420:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788651873.048427:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+25:3638:x1875537147575424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651873.048446:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651873.048452:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c29dc200/0xcd2f56ea038c3d74 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d6d expref: 25 pid: 6505 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.048857:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3d51 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.048872:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3d58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d51 expref: 25 pid: 6504 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651873.048883:0:13721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3681180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575296:0@lo:104: 00000100:00100000:3.0:1788651873.048930:0:13721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651873.048962:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147575296 00000100:00100000:1.0:1788651873.048989:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147575296 00000100:00100000:1.0:1788651873.049018:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788651873.049024:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3682300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:13721:x1875537147575296:12345-0@lo:104: 00010000:00010000:1.0:1788651873.049033:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.049075:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788651873.049081:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3682300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:13721:x1875537147575296:12345-0@lo:104: Request processed in 57us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651873.049088:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788651873.050548:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788651873.050568:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+25:3635:x1875537147575552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651873.050593:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651873.050603:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3d66 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d5f expref: 25 pid: 6505 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.052502:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c29dc200/0xcd2f56ea038c3d74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d6d expref: 25 pid: 6505 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.052543:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651873.052619:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+25:3638:x1875537147575424:12345-0@lo:103:ldlm_bl.0 Request processed in 4191us (4415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651873.052629:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00010000:3.0:1788651873.052668:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c3d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c3d43 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651873.052686:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147575424:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651873.052705:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c3d4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d43 expref: 24 pid: 6504 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651873.052719:0:13721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3683480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575680:0@lo:104: 00000100:00100000:3.0:1788651873.052759:0:13721:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788651873.052810:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33baf expref: 12 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.052821:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3d3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33baf expref: 12 pid: 6502 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651873.052831:0:13721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575808:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651873.052894:0:13721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c3d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ba8 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.052903:0:13721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c3d35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ba8 expref: 12 pid: 6504 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651873.052930:0:13721:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3680380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575936:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651873.052952:0:13721:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c23e1a80 going to sleep for 11 seconds 00010000:00010000:3.0:1788651873.052967:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c29dc200/0xcd2f56ea038c3d74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3d6d expref: 24 pid: 6505 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651873.052980:0:13721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3681c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575040:0@lo:104: 00000100:00100000:3.0:1788651873.052990:0:13721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3680700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575168:0@lo:104: 00000100:00100000:3.0:1788651873.052997:0:13721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3681180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575296:0@lo:104: 00010000:00010000:3.0:1788651873.053025:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651873.053036:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.053043:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651873.053047:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.053056:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651873.053063:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651873.053069:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788651873.053097:0:6499:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.053102:0:6499:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651873.053118:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.053125:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3d51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d58 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.053135:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651873.053137:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651873.053138:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651873.053837:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d5f expref: 23 pid: 6505 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.054184:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5200/0xcd2f56ea038c3d66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3d5f expref: 23 pid: 6505 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.054199:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651873.054257:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3635:x1875537147575552:12345-0@lo:103:ldlm_bl.0 Request processed in 3699us (5985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651873.054266:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788651873.054692:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147576064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651873.054727:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651873.054972:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147575552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651873.054996:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147575680 00000100:00100000:0.0:1788651873.055002:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147575680 00000100:00100000:0.0:1788651873.055041:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788651873.055050:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:13721:x1875537147575680:12345-0@lo:104: 00010000:00010000:0.0:1788651873.055065:0:6493:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.055112:0:6493:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788651873.055119:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+3:13721:x1875537147575680:12345-0@lo:104: Request processed in 70us (2360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651873.055125:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788651873.055144:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651873.055160:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.055168:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dce00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651873.055172:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.055181:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651873.055189:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651873.055195:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788651873.055211:0:13721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3683480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575680:0@lo:104: 00010000:00010000:0.0:1788651873.055223:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.055231:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651873.055254:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.055262:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c29dce00/0xcd2f56ea038c3d43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c3d4a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651873.055264:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651873.055280:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147576192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651873.055311:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651873.061034:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147576064 00000100:00100000:0.0:1788651873.061050:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147576064 00010000:00010000:0.0:1788651873.061101:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3d58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d51 expref: 22 pid: 6504 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651873.061138:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147576192 00000100:00100000:0.0:1788651873.061143:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147576192 00010000:00010000:0.0:1788651873.061157:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c3d4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d43 expref: 23 pid: 6504 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.061177:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651873.061182:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651873.061185:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651873.061199:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788651873.061208:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:3636:x1875537147576064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651873.061224:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651873.061231:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3d58 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d51 expref: 23 pid: 6504 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.061245:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d51 expref: 23 pid: 6504 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.061264:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3d58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3d51 expref: 23 pid: 6504 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.061281:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651873.061352:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3636:x1875537147576064:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (6623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651873.061360:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788651873.061377:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788651873.061383:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3681880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3638:x1875537147576192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651873.061392:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651873.061397:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c3d4a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d43 expref: 21 pid: 6504 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.061408:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c3d4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c3d43 expref: 21 pid: 6504 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.061421:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5800/0xcd2f56ea038c3d4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c3d43 expref: 21 pid: 6504 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.061443:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651873.061461:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147576064:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651873.061479:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3681880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:3638:x1875537147576192:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (6166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651873.061488:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788651873.061523:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147576192:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651873.064467:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651873.064566:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651873.064661:0:13721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575808:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651873.064674:0:13721:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3680380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13721:1875537147575936:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651873.064714:0:13721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651873.064780:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125468544 00000100:00100000:2.0:1788651873.064788:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125468544 00010000:00010000:2.0:1788651873.064827:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3d3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33baf expref: 13 pid: 6502 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651873.064859:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125468672 00000100:00100000:2.0:1788651873.064862:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125468672 00010000:00010000:2.0:1788651873.064875:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c3d35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ba8 expref: 14 pid: 6504 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651873.064901:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 50 00000100:00100000:0.0:1788651873.065060:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 51 00000100:00100000:0.0:1788651873.065070:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+14:2390:x1875537125468672:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651873.065085:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651873.065091:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c3d35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ba8 expref: 14 pid: 6504 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.065103:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c3d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ba8 expref: 14 pid: 6504 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.065120:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dda00/0xcd2f56ea038c3d35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ba8 expref: 14 pid: 6504 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651873.065136:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651873.065188:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2390:x1875537125468672:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 120us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651873.065196:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 51 00000100:00100000:3.0:1788651873.065399:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:2389:x1875537125468544:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651873.065409:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651873.065414:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3d3c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33baf expref: 12 pid: 6502 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065424:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3d3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33baf expref: 12 pid: 6502 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065435:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c29dcc00/0xcd2f56ea038c3d3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33baf expref: 12 pid: 6502 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065449:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065458:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065472:0:7919:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065496:0:7919:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065503:0:7919:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065510:0:7919:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065517:0:7919:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788651873.065521:0:7919:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065530:0:7919:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065556:0:7919:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065566:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651873.065588:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:2389:x1875537125468544:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 679us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651873.065595:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 50 00010000:00010000:3.0:1788651873.065616:0:13721:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065624:0:13721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651873.065630:0:13721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3eaf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651873.760100:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147576320:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788651873.760137:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651873.760181:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651873.760362:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147576320 00000100:00100000:1.0:1788651873.760383:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147576320 00000100:00100000:1.0:1788651873.760447:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788651873.760457:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147576320:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651873.760486:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651873.760554:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147576320:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651873.760561:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788651873.767662:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147576448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651873.767859:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788651873.767977:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff4ba300 x1875537147576320/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651873.767999:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147576320:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788651873.768591:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147576448 00000100:00100000:0.0:1788651873.768600:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147576448 00000100:00100000:0.0:1788651873.768661:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788651873.768673:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147576448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651873.768703:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651873.768763:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147576448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651873.768771:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:3.0:1788651873.768807:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34afb80 x1875537147576448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651889 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651873.768825:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147576448:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788651873.885375:0:13770:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd897e580 20000000:00000080:1.0:1788651873.885393:0:13770:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f86ff510400 uarg=0000000000000000 20000000:01000000:1.0:1788651873.885432:0:13770:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788651873.885438:0:13770:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:1.0:1788651873.885443:0:13770:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:3.0:1788651873.886293:0:13771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1788651873.886467:0:13770:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:1.0:1788651873.886553:0:13770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:1.0:1788651873.886584:0:13770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:1.0:1788651873.886600:0:13770:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:1.0:1788651873.886612:0:13770:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788651873.886633:0:13770:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3eb6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.886712:0:13770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3eb6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.886723:0:13770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3eb6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.886730:0:13770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3eb6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.886738:0:13770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3eb6 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.886755:0:13770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3eb6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.886762:0:13770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651873.886766:0:13770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3eb6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.886775:0:13770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3eb6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.886789:0:13770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3eb6 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.886797:0:13770:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3eb6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651873.886805:0:13770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3eb6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13770 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651874.272019:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788651874.272028:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f85c196d800 from 7 10000000:01000000:0.0:1788651874.272032:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788651874.272079:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651874.272100:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651874.272113:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651874.272140:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147576576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788651874.272214:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651874.272280:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc1d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788651874.272688:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147576576 00000100:00100000:1.0:1788651874.272697:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147576576 00000100:00100000:1.0:1788651874.272759:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1788651874.272769:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:6507:x1875537147576576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651874.272784:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651874.272800:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3ec4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3ebd expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651874.272824:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3ec4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ebd expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651874.272854:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3ec4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ebd expref: 21 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651874.272864:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414000, rc 0) 00000100:00100000:1.0:1788651874.272966:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147576576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651874.272974:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788651874.273207:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147576576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788651874.273224:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651874.273234:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651874.273297:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147576704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788651874.273328:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651874.273357:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc55cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651874.274000:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147576704 00000100:00100000:1.0:1788651874.274007:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147576704 00000100:00100000:1.0:1788651874.274050:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788651874.274058:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147576704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651874.274179:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147576704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651874.274186:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788651874.274471:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147576704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651874.274524:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147576832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651874.274577:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651874.274614:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc1de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651874.274676:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147576832 00000100:00100000:1.0:1788651874.274680:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147576832 00000100:00100000:1.0:1788651874.274763:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788651874.274772:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147576832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651874.274871:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147576832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 100us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651874.274878:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1788651874.274974:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147576832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651874.275182:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13783:1875537147576960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651874.275218:0:13783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651874.284493:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc1da80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651874.288497:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147576960 00000100:00100000:2.0:1788651874.288524:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147576960 00000100:00100000:2.0:1788651874.288582:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788651874.288592:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:13783:x1875537147576960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651874.288766:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:13783:x1875537147576960:12345-0@lo:502:llog_process_th.0 Request processed in 175us (13547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651874.288784:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1788651874.288940:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13783:1875537147576960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651874.288979:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651874.288991:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651874.288993:0:13783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788651874.289000:0:13783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f85c196d800 00000020:00000080:0.0:1788651874.289002:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788651874.289068:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651874.289072:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651874.289074:0:13783:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788651874.289076:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788651874.289078:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651874.289080:0:13783:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788651874.289083:0:13783:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f85c196d800 00000020:00000080:0.0:1788651874.289085:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788651874.289148:0:13783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13783:1875537147577088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651874.289192:0:13783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651874.289221:0:13783:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc1da80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651874.289553:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147577088 00000100:00100000:1.0:1788651874.289560:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147577088 00000100:00100000:1.0:1788651874.289591:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788651874.289598:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:13783:x1875537147577088:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651874.289685:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:13783:x1875537147577088:12345-0@lo:502:llog_process_th.0 Request processed in 87us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651874.289699:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:0.0:1788651874.292604:0:13783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13783:1875537147577088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651874.292655:0:13783:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651874.292666:0:13783:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651874.292668:0:13783:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788651874.292672:0:13783:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788651874.292750:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:0.0:1788651874.292773:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788651874.292783:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651874.292794:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651874.292816:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788651874.292818:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86eeab9800 from 7 10000000:01000000:0.0:1788651874.292821:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788651874.292856:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651874.292865:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651874.292874:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651874.292894:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147577216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788651874.292969:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651874.292997:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc1da80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651874.294883:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147577216 00000100:00100000:3.0:1788651874.294896:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147577216 00000100:00100000:3.0:1788651874.294984:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788651874.294993:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:6507:x1875537147577216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651874.295009:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651874.295033:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3ed2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3ecb expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.295061:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ecb expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.295072:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ecb expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.295082:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0031800, rc 0) 00000100:00100000:3.0:1788651874.295152:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147577216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.295165:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788651874.295231:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147577216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651874.295249:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.295259:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651874.295338:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147577344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.295373:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651874.295399:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651874.295410:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147577344 00000100:00100000:3.0:1788651874.295414:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147577344 00000100:00100000:3.0:1788651874.295429:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788651874.295436:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147577344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.295582:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147577344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 147us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.295589:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788651874.295633:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147577344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.295678:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147577472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.295743:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651874.295759:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651874.295772:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147577472 00000100:00100000:3.0:1788651874.295775:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147577472 00000100:00100000:3.0:1788651874.295795:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788651874.295810:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147577472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.295904:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147577472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.295936:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788651874.295988:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147577472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.296229:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13785:1875537147577600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651874.296267:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651874.296289:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147577600 00000100:00100000:3.0:1788651874.296293:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147577600 00000100:00100000:3.0:1788651874.296330:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788651874.296337:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:13785:x1875537147577600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651874.296410:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:13785:x1875537147577600:12345-0@lo:502:llog_process_th.0 Request processed in 72us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.296417:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788651874.296452:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651874.296465:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13785:1875537147577600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651874.296486:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651874.296493:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651874.296495:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788651874.296500:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86eeab9800 00000020:00000080:3.0:1788651874.296502:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788651874.296561:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651874.296565:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651874.296567:0:13785:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788651874.296569:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788651874.296572:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651874.296580:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788651874.296584:0:13785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86eeab9800 00000020:00000080:3.0:1788651874.296587:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788651874.296621:0:13785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13785:1875537147577728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651874.296656:0:13785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651874.296676:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147577728 00000100:00100000:3.0:1788651874.296679:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147577728 00000100:00100000:3.0:1788651874.296697:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788651874.296703:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:13785:x1875537147577728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651874.296765:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:13785:x1875537147577728:12345-0@lo:502:llog_process_th.0 Request processed in 61us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.296772:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:3.0:1788651874.296800:0:13785:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788651874.296810:0:13785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13785:1875537147577728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788651874.296828:0:13785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788651874.296832:0:13785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788651874.296833:0:13785:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788651874.296837:0:13785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788651874.296905:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788651874.296946:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788651874.296955:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.296965:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651874.296975:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788651874.296977:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86f48d9800 from 7 10000000:01000000:3.0:1788651874.296980:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788651874.297012:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.297025:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.297034:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651874.297047:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147577856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.297077:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651874.297098:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788651874.297109:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147577856 00000100:00100000:3.0:1788651874.297112:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147577856 00000100:00100000:3.0:1788651874.297136:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788651874.297142:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:6507:x1875537147577856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651874.297151:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651874.297162:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3ee0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3ed9 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.297180:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ed9 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.297191:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ed9 expref: 23 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.297200:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0030400, rc 0) 00000100:00100000:3.0:1788651874.297228:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147577856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.297235:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788651874.297275:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147577856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651874.297287:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.297295:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651874.297336:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147577984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.297362:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651874.297386:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788651874.297438:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147577984 00000100:00100000:0.0:1788651874.297444:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147577984 00000100:00100000:0.0:1788651874.297470:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788651874.297476:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147577984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651874.297806:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147577984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 329us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651874.297814:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788651874.298010:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147577984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.298050:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147578112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.298198:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651874.298222:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788651874.300083:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147578112 00000100:00100000:1.0:1788651874.300443:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147578112 00000100:00100000:1.0:1788651874.300517:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788651874.300526:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147578112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651874.300697:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147578112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 172us (2498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651874.300706:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788651874.301294:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3683b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147578112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651874.302780:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13786:1875537147578240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651874.302846:0:13786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651874.302887:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788651874.302955:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147578240 00000100:00100000:0.0:1788651874.302962:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147578240 00000100:00100000:0.0:1788651874.303005:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1788651874.303015:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:13786:x1875537147578240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651874.303301:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:13786:x1875537147578240:12345-0@lo:502:llog_process_th.0 Request processed in 287us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651874.303309:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1788651874.303563:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13786:1875537147578240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788651874.303592:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651874.303603:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651874.303606:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788651874.303614:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86f48d9800 00000020:00000080:1.0:1788651874.303616:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788651874.303717:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651874.303722:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651874.303723:0:13786:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788651874.303726:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788651874.303728:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651874.303729:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788651874.303733:0:13786:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86f48d9800 00000020:00000080:1.0:1788651874.303735:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788651874.307567:0:13786:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13786:1875537147578368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788651874.307657:0:13786:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651874.308530:0:13786:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c600 going to sleep for 11 seconds 00000100:00100000:2.0:1788651874.312274:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147578368 00000100:00100000:2.0:1788651874.312290:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147578368 00000100:00100000:2.0:1788651874.312428:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788651874.312439:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:13786:x1875537147578368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651874.312613:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:13786:x1875537147578368:12345-0@lo:502:llog_process_th.0 Request processed in 176us (4955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651874.312621:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788651874.313438:0:13786:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13786:1875537147578368:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788651874.313474:0:13786:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788651874.313483:0:13786:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788651874.313485:0:13786:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788651874.313491:0:13786:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788651874.313638:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788651874.313661:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788651874.313671:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651874.313682:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651874.313692:0:6507:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788651874.313694:0:6507:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86da667000 from 7 10000000:01000000:1.0:1788651874.313697:0:6507:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788651874.313725:0:6507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651874.313732:0:6507:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651874.313741:0:6507:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651874.313760:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147578496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788651874.313807:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651874.313838:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788651874.313863:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147578496 00000100:00100000:1.0:1788651874.313875:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147578496 00000100:00100000:1.0:1788651874.313939:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788651874.313947:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:6507:x1875537147578496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651874.313957:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651874.313970:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3eee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c3ee7 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651874.313993:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ee7 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651874.314004:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c3ee7 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651874.314012:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415200, rc 0) 00000100:00100000:1.0:1788651874.314046:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147578496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651874.314053:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788651874.314084:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147578496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788651874.324287:0:6507:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651874.324307:0:6507:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651874.335275:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147578624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651874.336223:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788651874.336954:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788651874.337166:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc1de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651874.343525:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147578624 00000100:00100000:1.0:1788651874.343540:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147578624 00000100:00100000:1.0:1788651874.343607:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788651874.343617:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147578624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651874.343808:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147578624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (7586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651874.343816:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788651874.348037:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651874.350485:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125468800 00000100:00100000:3.0:1788651874.350501:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125468800 00000100:00100000:3.0:1788651874.350590:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 359 00000100:00100000:3.0:1788651874.350600:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:6166:x1875537125468800:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651874.350619:0:6505:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651874.350637:0:6505:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c0031e00/0xcd2f56ea038c3ef5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33bfc expref: -99 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.350668:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0031e00/0xcd2f56ea038c3ef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bfc expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.350679:0:6505:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c0031e00/0xcd2f56ea038c3ef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bfc expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.350704:0:6505:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0031e00, rc 0) 00000100:00100000:3.0:1788651874.350774:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125468800:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 Request processed in 175us (2747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.350782:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 359 00000100:00100000:1.0:1788651874.356382:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147578624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788651874.356449:0:6507:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147578752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788651874.356542:0:6507:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651874.356633:0:6507:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c3c1c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788651874.356725:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147578752 00000100:00100000:3.0:1788651874.356732:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147578752 00000100:00100000:3.0:1788651874.356976:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788651874.356989:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147578752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.357120:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:6507:x1875537147578752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.357128:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788651874.357203:0:6507:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1387a7f4-5194-4c3d-9855-aa6dad12ca23:6507:1875537147578752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788651874.359289:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651874.359578:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13790:1875537147578880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651874.359647:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651874.359686:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d28f5300 going to sleep for 11 seconds 00000100:00100000:0.0:1788651874.360069:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125468928 00000100:00100000:0.0:1788651874.360077:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125468928 00000100:00100000:0.0:1788651874.360132:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147578880 00000100:00100000:0.0:1788651874.360136:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147578880 00000100:00100000:0.0:1788651874.360154:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 361 00000100:00100000:0.0:1788651874.360163:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125468928:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788651874.360303:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125468928:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 Request processed in 140us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651874.360312:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 361 00000100:00100000:0.0:1788651874.360467:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788651874.360475:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:13790:x1875537147578880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788651874.360582:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:13790:x1875537147578880:12345-0@lo:502:llog_process_th.0 Request processed in 107us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651874.360589:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788651874.362201:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13790:1875537147578880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788651874.362247:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651874.362257:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651874.362260:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788651874.362269:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86da667000 00000020:00000080:2.0:1788651874.362273:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788651874.362347:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788651874.362352:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651874.362354:0:13790:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788651874.362356:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788651874.362360:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788651874.362361:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788651874.362365:0:13790:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86da667000 00000020:00000080:2.0:1788651874.362374:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788651874.362427:0:13790:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13790:1875537147579008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788651874.362494:0:13790:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651874.362541:0:13790:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3e7cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788651874.362783:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147579008 00000100:00100000:3.0:1788651874.362790:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147579008 00000100:00100000:3.0:1788651874.367082:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788651874.367111:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:13790:x1875537147579008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788651874.367295:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:13790:x1875537147579008:12345-0@lo:502:llog_process_th.0 Request processed in 191us (4799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.367305:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:0.0:1788651874.367714:0:13790:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1387a7f4-5194-4c3d-9855-aa6dad12ca23:13790:1875537147579008:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788651874.367756:0:13790:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788651874.367765:0:13790:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788651874.367768:0:13790:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788651874.367779:0:13790:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000100:00100000:0.0:1788651874.368197:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651874.375655:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125469056 00000100:00100000:2.0:1788651874.375669:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125469056 00000100:00100000:2.0:1788651874.375729:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 364 00000100:00100000:2.0:1788651874.375738:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125469056:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651874.375963:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125469056:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 Request processed in 225us (7767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651874.375971:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 364 00000020:01000000:2.0:1788651874.376015:0:6507:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788651874.376046:0:6507:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788651874.376055:0:6507:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651874.376066:0:6507:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788651874.378577:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788651874.396128:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651874.396284:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125469184 00000100:00100000:2.0:1788651874.396296:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125469184 00000100:00100000:2.0:1788651874.396366:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 365 00000100:00100000:2.0:1788651874.396377:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:10789:x1875537125469184:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788651874.396535:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:10789:x1875537125469184:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 159us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651874.396543:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 365 00000100:00100000:0.0:1788651874.411516:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651874.413441:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125469312 00000100:00100000:1.0:1788651874.413455:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125469312 00000100:00100000:1.0:1788651874.413524:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 366 00000100:00100000:1.0:1788651874.413534:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:10789:x1875537125469312:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788651874.413693:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:10789:x1875537125469312:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 160us (2195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651874.413702:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 366 00000100:00100000:0.0:1788651874.432021:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651874.432274:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125469440 00000100:00100000:3.0:1788651874.432285:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125469440 00000100:00100000:3.0:1788651874.432353:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 367 00000100:00100000:3.0:1788651874.432364:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:6166:x1875537125469440:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788651874.432380:0:6504:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651874.432399:0:6504:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c3efc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c03 expref: -99 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.432449:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c3efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c03 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.432462:0:6504:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c3efc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c03 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651874.432471:0:6504:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0031200, rc 0) 00000100:00100000:3.0:1788651874.432533:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:6166:x1875537125469440:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 Request processed in 171us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.432541:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 367 00000100:00100000:0.0:1788651874.441528:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651874.441748:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125469568 00000100:00100000:3.0:1788651874.441757:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125469568 00000100:00100000:3.0:1788651874.441813:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 368 00000100:00100000:3.0:1788651874.441830:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:6166:x1875537125469568:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788651874.442053:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:6166:x1875537125469568:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 Request processed in 225us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.442061:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 368 00000100:00100000:0.0:1788651874.462996:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651874.463046:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125469696 00000100:00100000:2.0:1788651874.463055:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125469696 00000100:00100000:2.0:1788651874.463105:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 369 00000100:00100000:2.0:1788651874.463115:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:6166:x1875537125469696:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788651874.463256:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:6166:x1875537125469696:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 Request processed in 141us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651874.463264:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 369 00000100:00100000:0.0:1788651874.470736:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651874.473168:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125469824 00000100:00100000:3.0:1788651874.473183:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125469824 00000100:00100000:3.0:1788651874.473247:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 370 00000100:00100000:3.0:1788651874.473257:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:10793:x1875537125469824:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788651874.473411:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702076850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:10793:x1875537125469824:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 154us (2684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651874.473419:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 370 00000100:00100000:0.0:1788651874.479619:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651874.479968:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125469952 00000100:00100000:1.0:1788651874.479980:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125469952 00000100:00100000:1.0:1788651874.480032:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 371 00000100:00100000:1.0:1788651874.480042:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:10793:x1875537125469952:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788651874.480184:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702074450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:10793:x1875537125469952:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 142us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651874.480192:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 371 00000100:00100000:3.0:1788651874.784223:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147579136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651874.784315:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651874.785807:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147579136 00000100:00100000:0.0:1788651874.785821:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147579136 00000100:00100000:0.0:1788651874.785896:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788651874.785932:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147579136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788651874.785975:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788651874.795147:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147579136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 9231us (10820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651874.795163:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00010000:00010000:2.0:1788651874.795353:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651874.797693:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147579136:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788651875.364372:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788651875.425730:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788651875.810255:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651876.320495:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651876.320518:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147579264:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651876.320594:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651876.320937:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147579264 00000100:00100000:0.0:1788651876.320947:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147579264 00000100:00100000:0.0:1788651876.321001:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788651876.321010:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147579264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788651876.321045:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788651876.321103:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147579264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651876.321110:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788651876.321235:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147579264:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651876.514128:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651876.514176:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651876.514206:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651876.514251:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651876.514271:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651876.514291:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651876.514366:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125470208 00000100:00100000:1.0:1788651876.514376:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125470208 00000100:00100000:2.0:1788651876.514402:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125470080 00000100:00100000:2.0:1788651876.514409:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125470080 00000100:00100000:1.0:1788651876.514444:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125470336 00000100:00100000:1.0:1788651876.514450:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125470336 00000100:00100000:2.0:1788651876.514455:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 372 00000100:00100000:2.0:1788651876.514485:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125470080:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651876.514490:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125470592 00000100:00100000:1.0:1788651876.514494:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125470592 00000100:00100000:1.0:1788651876.514510:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125470720 00000100:00100000:1.0:1788651876.514513:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125470720 00000100:00100000:1.0:1788651876.514530:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 230 00000100:00100000:1.0:1788651876.514539:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125470208:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651876.514560:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702074c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125470080:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 92us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651876.514569:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 372 00000100:00100000:1.0:1788651876.514578:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125470208:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 39us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651876.514586:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 230 00000100:00100000:1.0:1788651876.514604:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 231 00000100:00100000:1.0:1788651876.514610:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125470336:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651876.514637:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125470336:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 27us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651876.514643:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 231 00000100:00100000:1.0:1788651876.514654:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 232 00000100:00100000:1.0:1788651876.514660:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125470592:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651876.514682:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125470592:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 22us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651876.514687:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 232 00000100:00100000:1.0:1788651876.514697:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 233 00000100:00100000:1.0:1788651876.514703:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125470720:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651876.514723:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125470720:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 21us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651876.514744:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 233 00000100:00080000:0.0:1788651876.514802:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651876.514807:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651876.515003:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125470464 00000100:00100000:3.0:1788651876.515008:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125470464 00000100:00100000:3.0:1788651876.515058:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 87 00000100:00100000:3.0:1788651876.515066:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125470464:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651876.515111:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125470464:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 47us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651876.515117:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 87 00000100:00080000:0.0:1788651876.515213:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788651876.836075:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651877.856194:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651877.856218:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147579392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788651877.856291:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651877.856362:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147579392 00000100:00100000:0.0:1788651877.856370:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147579392 00010000:00010000:1.0:1788651877.856382:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788651877.856412:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651877.856428:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788651877.856450:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147579392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788651877.856481:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651877.856536:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147579392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651877.856544:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788651877.856617:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147579392:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651877.856884:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147579520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651877.856945:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651877.856991:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147579520 00000100:00100000:1.0:1788651877.856995:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147579520 00000100:00100000:1.0:1788651877.857028:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788651877.857035:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875537147579520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651877.857046:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651877.857077:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3635:x1875537147579520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651877.857084:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1788651877.857085:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788651877.857116:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147579520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651877.857323:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147579648:0@lo:400:kworker.0 00000100:00100000:1.0:1788651877.857362:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651877.857380:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147580032:0@lo:400:kworker.0 00000100:00100000:1.0:1788651877.857392:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147580160:0@lo:400:kworker.0 00000100:00100000:2.0:1788651877.857422:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651877.857446:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651877.857460:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147580544:0@lo:400:kworker.0 00000100:00100000:1.0:1788651877.857469:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147580672:0@lo:400:kworker.0 00000100:00100000:2.0:1788651877.857498:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651877.857504:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651877.857740:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147580544 00000100:00100000:2.0:1788651877.857744:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147580544 00000100:00100000:2.0:1788651877.857773:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147580672 00000100:00100000:2.0:1788651877.857776:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147580672 00000100:00100000:2.0:1788651877.857809:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788651877.857816:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147580544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.857888:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147579648 00000100:00100000:3.0:1788651877.857892:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147579648 00000100:00100000:3.0:1788651877.857946:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788651877.857955:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f8702077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147579648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651877.857984:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788651877.857994:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147580672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858004:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f8702077c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147579648:12345-0@lo:400:kworker.0 Request processed in 50us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651877.858013:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788651877.858032:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147580672:12345-0@lo:400:kworker.0 Request processed in 40us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651877.858039:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:3.0:1788651877.858049:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651877.858063:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147580032 00000100:00100000:1.0:1788651877.858072:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147580032 00000100:00100000:1.0:1788651877.858100:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00010000:00080000:3.0:1788651877.858106:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3731880 x1875537147580672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651877.858108:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147580032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858139:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147580672:0@lo:400:kworker.0 00000100:00100000:1.0:1788651877.858151:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147580032:12345-0@lo:400:kworker.0 Request processed in 44us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651877.858158:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147579648:0@lo:400:kworker.0 00000100:00100000:1.0:1788651877.858162:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788651877.858193:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147580032:0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858212:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147579776:0@lo:400:kworker.0 00000100:00100000:1.0:1788651877.858231:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147580160 00000100:00100000:1.0:1788651877.858235:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147580160 00000100:00100000:3.0:1788651877.858247:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651877.858265:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788651877.858273:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147580288:0@lo:400:kworker.0 00000100:00100000:1.0:1788651877.858275:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147580160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858300:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651877.858317:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147580800:0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858340:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651877.858356:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788651877.858362:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147579904:0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858382:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651877.858400:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147580416:0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858421:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651877.858436:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147580928:0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858470:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651877.858498:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147579776 00000100:00100000:3.0:1788651877.858503:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147579776 00000100:00100000:1.0:1788651877.858516:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147580160:12345-0@lo:400:kworker.0 Request processed in 242us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651877.858523:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147580288 00000100:00100000:1.0:1788651877.858525:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788651877.858527:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147580288 00000100:00100000:1.0:1788651877.858540:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147579904 00000100:00100000:1.0:1788651877.858545:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147579904 00000100:00100000:3.0:1788651877.858553:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147580800 00000100:00100000:3.0:1788651877.858558:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147580800 00000100:00100000:3.0:1788651877.858573:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147580416 00000100:00100000:3.0:1788651877.858576:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147580416 00000100:00100000:3.0:1788651877.858585:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147580928 00000100:00100000:3.0:1788651877.858588:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147580928 00000100:00100000:3.0:1788651877.858609:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788651877.858614:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147579776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858648:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147579776:12345-0@lo:400:kworker.0 Request processed in 33us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651877.858654:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788651877.858665:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788651877.858670:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147580288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858695:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3681c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147580288:12345-0@lo:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651877.858700:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788651877.858711:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788651877.858716:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147580800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858740:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147580800:12345-0@lo:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651877.858745:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788651877.858755:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788651877.858761:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147580416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858784:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147580416:12345-0@lo:400:kworker.0 Request processed in 24us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651877.858790:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788651877.858799:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788651877.858804:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147580928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858826:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147580928:12345-0@lo:400:kworker.0 Request processed in 23us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651877.858831:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1788651877.858854:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788651877.858865:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147579904:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788651877.858868:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651877.858873:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788651877.858895:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff4b9c00 x1875537147580416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651877.858928:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147579904:12345-0@lo:400:kworker.0 Request processed in 43us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651877.858934:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147580416:0@lo:400:kworker.0 00000100:00100000:1.0:1788651877.858939:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00080000:3.0:1788651877.858956:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c310aa00 x1875537147580928/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651877.858966:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147580928:0@lo:400:kworker.0 00000100:00100000:1.0:1788651877.858978:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147580160:0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858983:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147579776:0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.858998:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147580288:0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.859010:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147580800:0@lo:400:kworker.0 00000100:00100000:3.0:1788651877.859033:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147579904:0@lo:400:kworker.0 00000100:00100000:2.0:1788651877.863368:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147580544:12345-0@lo:400:kworker.0 Request processed in 5543us (5861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651877.863382:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00080000:1.0:1788651877.864275:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3730000 x1875537147580544/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651893 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651877.864291:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147580544:0@lo:400:kworker.0 00000001:00080000:0.0:1788651877.865899:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:3.0:1788651878.880257:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651878.880535:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c358aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147581184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651878.880621:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651878.880718:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651878.880726:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147581056:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651878.880757:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651878.880811:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147581184 00000100:00100000:1.0:1788651878.880819:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147581184 00000100:00100000:1.0:1788651878.880865:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147581056 00000100:00100000:1.0:1788651878.880868:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147581056 00000100:00100000:1.0:1788651878.880892:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788651878.880901:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147581184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651878.880965:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651878.881013:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3589880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147581184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651878.881020:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788651878.881045:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788651878.881051:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147581056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651878.881068:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651878.881101:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147581056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 50us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651878.881107:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00010000:00080000:1.0:1788651878.881154:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c310b480 x1875537147581056/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651878.881192:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147581056:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788651878.881206:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c358aa00 x1875537147581184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651894 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651878.881252:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c358aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147581184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788651879.906925:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651879.907628:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c358aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147581312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651879.907695:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651879.908948:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147581312 00000100:00100000:1.0:1788651879.908960:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147581312 00000100:00100000:1.0:1788651879.909024:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788651879.909034:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147581312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651879.909069:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651879.909186:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147581312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 153us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651879.909194:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788651879.911008:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c358aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147581312:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788651880.928133:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651881.440643:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c358b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147581440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651881.440720:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651881.441017:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147581440 00000100:00100000:1.0:1788651881.441027:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147581440 00000100:00100000:1.0:1788651881.441163:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788651881.441174:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147581440:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651881.441211:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788651881.441276:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147581440:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651881.441283:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788651881.441568:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c358b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147581440:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651881.634222:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651881.634267:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651881.634301:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651881.634384:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125470848 00000100:00100000:2.0:1788651881.634394:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125470848 00000100:00100000:3.0:1788651881.634437:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125471104 00000100:00100000:3.0:1788651881.634443:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125471104 00000100:00100000:2.0:1788651881.634454:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 374 00000100:00100000:2.0:1788651881.634463:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125470848:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651881.634480:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125471360 00000100:00100000:3.0:1788651881.634482:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125471360 00000100:00100000:3.0:1788651881.634500:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 240 00000100:00100000:3.0:1788651881.634506:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125471104:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651881.634530:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c13fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125470848:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 68us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651881.634537:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 374 00000100:00100000:3.0:1788651881.634550:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125471104:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 45us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651881.634556:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 240 00000100:00100000:3.0:1788651881.634567:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 241 00000100:00100000:3.0:1788651881.634574:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125471360:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651881.634596:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125471360:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 23us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651881.634601:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 241 00000100:00080000:3.0:1788651881.634616:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651881.634620:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788651881.635270:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651881.635342:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651881.635443:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651881.635481:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125471232 00000100:00100000:3.0:1788651881.635486:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125471232 00000100:00100000:3.0:1788651881.635535:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 90 00000100:00100000:3.0:1788651881.635542:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125471232:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651881.635585:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125471232:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 43us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651881.635591:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 90 00000100:00080000:0.0:1788651881.635722:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788651881.640016:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125470976 00000100:00100000:1.0:1788651881.640031:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125470976 00000100:00100000:1.0:1788651881.640130:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125471488 00000100:00100000:1.0:1788651881.640134:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125471488 00000100:00100000:1.0:1788651881.640171:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 242 00000100:00100000:1.0:1788651881.640182:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125470976:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651881.640266:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125470976:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 87us (4998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651881.640292:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 242 00000100:00100000:1.0:1788651881.640311:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 243 00000100:00100000:1.0:1788651881.640318:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125471488:12345-192.168.204.45@tcp:400:kworker.0 00000100:00080000:0.0:1788651881.640525:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651881.640530:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651881.641029:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125471488:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 30us (4904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651881.641041:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 243 00010000:00010000:3.0:1788651881.961166:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651882.976175:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651882.976205:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147581696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651882.976336:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651882.976424:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147581824:0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.976426:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147582208:0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.976484:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651882.976491:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651882.976520:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147582720:0@lo:400:kworker.0 00000100:00100000:0.0:1788651882.976532:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147582336:0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.976551:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651882.976560:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147581568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651882.976580:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147583232:0@lo:400:kworker.0 00000100:00100000:0.0:1788651882.976585:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651882.976602:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651882.976615:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147582848:0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.976628:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651882.976632:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147582080:0@lo:400:kworker.0 00000100:00100000:0.0:1788651882.976666:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147581824 00000100:00100000:0.0:1788651882.976675:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147581824 00000100:00100000:2.0:1788651882.976698:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147582720 00000100:00100000:2.0:1788651882.976704:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147582720 00000100:00100000:0.0:1788651882.976723:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:0.0:1788651882.976744:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147581824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651882.976745:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147583232 00000100:00100000:2.0:1788651882.976750:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147583232 00000100:00100000:2.0:1788651882.976774:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788651882.976783:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147582720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.976839:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651882.976859:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147582592:0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.976882:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651882.976964:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147583104:0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.976987:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651882.977018:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147581952:0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.977041:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651882.977056:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147582464:0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.977073:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651882.977087:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147582976:0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.977108:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651882.977137:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788651882.977146:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147583232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.977178:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147583232:12345-0@lo:400:kworker.0 Request processed in 34us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651882.977184:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788651882.977206:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147581696 00000100:00100000:3.0:1788651882.977210:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147581696 00000100:00100000:3.0:1788651882.977226:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147581568 00000100:00100000:3.0:1788651882.977229:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147581568 00000100:00100000:3.0:1788651882.977244:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788651882.977250:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147581696:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788651882.977270:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651882.977300:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147581696:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651882.977307:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788651882.977319:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788651882.977324:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147581568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651882.977333:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651882.977378:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147581568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651882.977384:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788651882.977427:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147582208 00000100:00100000:3.0:1788651882.977431:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147582208 00000100:00100000:3.0:1788651882.977451:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147582592 00000100:00100000:3.0:1788651882.977455:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147582592 00000100:00100000:3.0:1788651882.977467:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147583104 00000100:00100000:3.0:1788651882.977470:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147583104 00000100:00100000:3.0:1788651882.977481:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147581952 00000100:00100000:3.0:1788651882.977484:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147581952 00000100:00100000:3.0:1788651882.977494:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147582464 00000100:00100000:3.0:1788651882.977497:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147582464 00000100:00100000:3.0:1788651882.977507:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147582976 00000100:00100000:3.0:1788651882.977510:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147582976 00000100:00100000:3.0:1788651882.977524:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788651882.977530:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147582208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.977561:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147582208:12345-0@lo:400:kworker.0 Request processed in 31us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651882.977567:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788651882.977578:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788651882.977584:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147582592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.977609:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147582592:12345-0@lo:400:kworker.0 Request processed in 26us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651882.977614:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788651882.977629:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788651882.977635:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147583104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.977655:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147583104:12345-0@lo:400:kworker.0 Request processed in 21us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651882.977671:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788651882.977681:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788651882.977686:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147581952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.977716:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147581952:12345-0@lo:400:kworker.0 Request processed in 30us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651882.977721:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788651882.977732:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788651882.977737:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147582464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.978264:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147582464:12345-0@lo:400:kworker.0 Request processed in 525us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651882.978270:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788651882.978283:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788651882.978288:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147582976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.985774:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147583232:0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.985802:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147581696:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651882.985842:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147582208:0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.985933:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147582336 00000100:00100000:1.0:1788651882.985941:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147582336 00000100:00100000:1.0:1788651882.985988:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147582080 00000100:00100000:1.0:1788651882.985992:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147582080 00000100:00100000:1.0:1788651882.986006:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788651882.986028:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147582336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.986101:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147582336:12345-0@lo:400:kworker.0 Request processed in 74us (9519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651882.986108:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788651882.986125:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788651882.986130:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147582080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.986157:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147582080:12345-0@lo:400:kworker.0 Request processed in 27us (9317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651882.986162:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788651882.986182:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651882.986210:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147583360:0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.986245:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651882.986267:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147582336:0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.987191:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147582976:12345-0@lo:400:kworker.0 Request processed in 8896us (10075us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651882.987202:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788651882.987235:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147582848 00000100:00100000:3.0:1788651882.987241:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147582848 00000100:00100000:3.0:1788651882.987267:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147583360 00000100:00100000:3.0:1788651882.987269:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147583360 00000100:00100000:3.0:1788651882.987281:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788651882.987287:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147582848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651882.987452:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147582720:12345-0@lo:400:kworker.0 Request processed in 10669us (10900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651882.987460:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788651882.987475:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788651882.987481:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147583360:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788651882.987609:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651882.987615:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788651882.987618:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651882.987621:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788651882.987683:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff4b8380 x1875537147582720/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651882.987695:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147582720:0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.987735:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147581952:0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.987746:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147582464:0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.987757:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147582976:0@lo:400:kworker.0 00000100:00100000:1.0:1788651882.987781:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788651882.987798:0:3635:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f86ff4b9180, transno 4294967301 00000100:00100000:1.0:1788651882.987816:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147581568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651882.987837:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147582080:0@lo:400:kworker.0 00000100:00100000:3.0:1788651882.987847:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147582848:12345-0@lo:400:kworker.0 Request processed in 554us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651882.987847:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c13ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147581824:12345-0@lo:400:kworker.0 Request processed in 11099us (11349us total) trans 0 rc 0/0 00010000:00080000:1.0:1788651882.987855:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff4ba300 x1875537147582592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651882.987864:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788651882.987868:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00100000:1.0:1788651882.987875:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147582592:0@lo:400:kworker.0 00010000:00080000:1.0:1788651882.987890:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3730380 x1875537147583104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651882.987899:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147583104:0@lo:400:kworker.0 00000100:00100000:0.0:1788651882.987945:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147581824:0@lo:400:kworker.0 00010000:00080000:0.0:1788651882.987962:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3730000 x1875537147582848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651898 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651882.987973:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147582848:0@lo:400:kworker.0 00000100:00100000:2.0:1788651882.988265:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147583360:12345-0@lo:400:kworker.0 Request processed in 784us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651882.988281:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788651882.988612:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147583360:0@lo:400:kworker.0 00010000:00010000:1.0:1788651884.001177:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651884.001514:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651884.001536:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147583488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651884.001606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651884.001683:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147583616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651884.001717:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651884.002041:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147583488 00000100:00100000:2.0:1788651884.002050:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147583488 00000100:00100000:2.0:1788651884.002111:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147583616 00000100:00100000:2.0:1788651884.002114:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147583616 00000100:00100000:2.0:1788651884.002130:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788651884.002138:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147583488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788651884.002171:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651884.002222:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147583488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 84us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651884.002229:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788651884.002247:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00010000:00080000:3.0:1788651884.002307:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff51c700 x1875537147583488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651884.002366:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147583488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651884.002391:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147583616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651884.002407:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651884.002449:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147583616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651884.002455:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788651884.002506:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788651884.002558:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c37c6300 x1875537147583616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651900 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651884.002572:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147583616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788651885.024380:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651885.024612:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651885.024633:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c358aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147583744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651885.024705:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651885.024954:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147583744 00000100:00100000:1.0:1788651885.024963:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147583744 00000100:00100000:1.0:1788651885.025023:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788651885.025033:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147583744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651885.025066:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651885.025123:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147583744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 91us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651885.025130:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788651885.025229:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c358aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147583744:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788651885.600590:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788651885.665942:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788651886.048138:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651886.562104:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651886.562129:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c358aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147583872:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651886.562209:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651886.562458:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147583872 00000100:00100000:1.0:1788651886.562467:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147583872 00000100:00100000:1.0:1788651886.562521:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788651886.562531:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147583872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651886.562566:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788651886.562648:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147583872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 118us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651886.562656:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788651886.562994:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c358aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147583872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651886.757831:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651886.758921:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651886.758994:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651886.764954:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125471616 00000100:00100000:0.0:1788651886.764969:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125471616 00000100:00100000:0.0:1788651886.765041:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 376 00000100:00100000:0.0:1788651886.765052:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125471616:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651886.765151:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7cc1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125471616:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 100us (7338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651886.765565:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651886.767149:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 376 00000100:00100000:1.0:1788651886.772086:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125471744 00000100:00100000:1.0:1788651886.772102:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125471744 00000100:00100000:1.0:1788651886.772396:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125471872 00000100:00100000:1.0:1788651886.772402:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125471872 00000100:00100000:1.0:1788651886.772447:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 250 00000100:00100000:1.0:1788651886.772459:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125471744:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651886.772537:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125471744:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 82us (13632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651886.772545:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 250 00000100:00080000:2.0:1788651886.773436:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788651886.773442:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651886.773473:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125472128 00000100:00100000:2.0:1788651886.773478:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125472128 00000100:00100000:2.0:1788651886.773530:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 251 00000100:00100000:2.0:1788651886.773538:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125471872:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651886.774068:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 252 00000100:00100000:1.0:1788651886.774078:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125472128:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651886.774120:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125472128:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 45us (8568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651886.774126:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 252 00000100:00100000:2.0:1788651886.774424:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125471872:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 886us (15429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651886.774431:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 251 00000100:00080000:2.0:1788651886.774449:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651886.775792:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651886.777500:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125472000 00000100:00100000:2.0:1788651886.777514:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125472000 00000100:00100000:2.0:1788651886.777584:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 95 00000100:00100000:2.0:1788651886.777594:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125472000:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651886.777754:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2390:x1875537125472000:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 161us (1964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651886.777785:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651886.777814:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125472256 00000100:00100000:1.0:1788651886.777818:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125472256 00000100:00100000:1.0:1788651886.777848:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 253 00000100:00100000:1.0:1788651886.777854:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125472256:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651886.777882:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2390:x1875537125472256:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 28us (99us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651886.777889:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 253 00000100:00100000:2.0:1788651886.777943:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 95 00000100:00080000:2.0:1788651886.777967:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788651886.777981:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788651887.073304:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651888.096263:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147584384:0@lo:400:kworker.0 00000100:00100000:1.0:1788651888.096334:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651888.096383:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147584256:0@lo:400:kworker.0 00000100:00100000:1.0:1788651888.096392:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147584896:0@lo:400:kworker.0 00000100:00100000:3.0:1788651888.096429:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651888.096434:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651888.096456:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147584768:0@lo:400:kworker.0 00000100:00100000:3.0:1788651888.096479:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651888.096503:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147585280:0@lo:400:kworker.0 00000100:00100000:3.0:1788651888.096524:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651888.096574:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788651888.096648:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147584128:0@lo:400:kworker.0 00000100:00100000:3.0:1788651888.096674:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651888.096693:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147584640:0@lo:400:kworker.0 00000100:00100000:3.0:1788651888.096713:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651888.096726:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147585152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651888.096747:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651888.096766:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147585664:0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.096962:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651888.096972:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147585792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651888.096991:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147584256 00000100:00100000:0.0:1788651888.096997:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651888.096998:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147584256 00000100:00100000:0.0:1788651888.097028:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147585152 00000100:00100000:0.0:1788651888.097031:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147585152 00000100:00100000:3.0:1788651888.097039:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788651888.097048:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147584256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.097055:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147585792 00000100:00100000:0.0:1788651888.097058:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147585792 00000100:00100000:0.0:1788651888.097070:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788651888.097076:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147585152:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651888.097097:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147584256:12345-0@lo:400:kworker.0 Request processed in 49us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651888.097104:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00002000:00000024:0.0:1788651888.097110:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651888.097141:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147585152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651888.097147:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788651888.097163:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788651888.097169:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147585792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788651888.097178:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00080000:2.0:1788651888.097205:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651888.097205:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147585792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 37us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651888.097211:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788651888.097217:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147584000:0@lo:400:kworker.0 00000100:00100000:2.0:1788651888.097325:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651888.097351:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147584512:0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.097353:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147585792:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651888.097374:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651888.097380:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147584384 00000100:00100000:0.0:1788651888.097384:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147584384 00000100:00100000:2.0:1788651888.097390:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147585024:0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.097404:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147584768 00000100:00100000:0.0:1788651888.097414:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147584768 00000100:00100000:2.0:1788651888.097415:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147584512 00000100:00100000:2.0:1788651888.097417:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147584512 00000100:00080000:0.0:1788651888.097428:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788651888.097433:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788651888.097438:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147584512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.097440:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147585280 00000100:00100000:0.0:1788651888.097443:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147585280 00000100:00080000:0.0:1788651888.097451:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651888.097462:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147584128 00000100:00100000:0.0:1788651888.097465:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147584128 00000100:00100000:2.0:1788651888.097472:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147584512:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651888.097475:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147584640 00000100:00100000:0.0:1788651888.097477:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147584640 00000100:00100000:2.0:1788651888.097484:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1788651888.097487:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651888.097500:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788651888.097505:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147584384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651888.097526:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788651888.097533:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147584768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.097535:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147584384:12345-0@lo:400:kworker.0 Request processed in 31us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651888.097541:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788651888.097553:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788651888.097558:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147585280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651888.097575:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147584768:12345-0@lo:400:kworker.0 Request processed in 43us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651888.097583:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147585280:12345-0@lo:400:kworker.0 Request processed in 26us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651888.097589:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788651888.097600:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788651888.097606:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147584128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.097631:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147584128:12345-0@lo:400:kworker.0 Request processed in 26us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651888.097637:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788651888.097648:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788651888.097654:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147584640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.097680:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147584640:12345-0@lo:400:kworker.0 Request processed in 26us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651888.097691:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788651888.097694:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00010000:00010000:2.0:1788651888.097720:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651888.097730:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147584000 00000100:00100000:0.0:1788651888.097734:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147584000 00000100:00100000:0.0:1788651888.097760:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788651888.097766:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147584000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.099202:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7cc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147584000:12345-0@lo:400:kworker.0 Request processed in 1431us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651888.099213:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:1.0:1788651888.099488:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147585408:0@lo:400:kworker.0 00000100:00100000:1.0:1788651888.099522:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651888.099557:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147584384:0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.099771:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651888.100150:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147584256:0@lo:400:kworker.0 00010000:00080000:0.0:1788651888.100166:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c1f80 x1875537147584768/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651888.100176:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147584768:0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.100190:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147585280:0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.100209:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147584128:0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.100220:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147584640:0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.100237:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147585152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651888.100276:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147585408 00000100:00100000:0.0:1788651888.100282:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147585408 00000100:00080000:0.0:1788651888.100305:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788651888.100341:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788651888.100347:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147585408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651888.100395:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147585408:12345-0@lo:400:kworker.0 Request processed in 47us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651888.100412:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788651888.100852:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788651888.102114:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff51ad80 x1875537147585408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651888.102130:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147585408:0@lo:400:kworker.0 00000100:00100000:1.0:1788651888.112524:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147585536:0@lo:400:kworker.0 00000100:00100000:1.0:1788651888.112593:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651888.117988:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147584896 00000100:00100000:2.0:1788651888.118004:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147584896 00000100:00100000:2.0:1788651888.118083:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147585664 00000100:00100000:2.0:1788651888.118087:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147585664 00000100:00100000:3.0:1788651888.118199:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147585024 00000100:00100000:3.0:1788651888.118205:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147585024 00000100:00100000:2.0:1788651888.118212:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788651888.118223:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147584896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651888.118331:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147584896:12345-0@lo:400:kworker.0 Request processed in 109us (21898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651888.118338:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788651888.118357:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788651888.118363:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147585664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651888.118401:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147585664:12345-0@lo:400:kworker.0 Request processed in 39us (18633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651888.118408:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1788651888.118433:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651888.118469:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147585664:0@lo:400:kworker.0 00010000:00080000:2.0:1788651888.118507:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c1c00 x1875537147584896/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651888.118519:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147584896:0@lo:400:kworker.0 00000100:00100000:3.0:1788651888.119198:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788651888.119206:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147585024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651888.119280:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147585024:12345-0@lo:400:kworker.0 Request processed in 75us (18429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651888.119287:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788651888.119733:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147584000:0@lo:400:kworker.0 00000100:00100000:1.0:1788651888.119747:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147584512:0@lo:400:kworker.0 00010000:00080000:1.0:1788651888.119758:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c2a00 x1875537147585024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651904 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651888.119774:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147585024:0@lo:400:kworker.0 00000100:00100000:3.0:1788651888.120120:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147585536 00000100:00100000:3.0:1788651888.120126:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147585536 00000100:00100000:3.0:1788651888.120168:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1788651888.120168:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651888.120179:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147585536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651888.120262:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147585536:12345-0@lo:400:kworker.0 Request processed in 84us (7668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651888.120270:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788651888.120297:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147585536:0@lo:400:kworker.0 00010000:00010000:1.0:1788651889.121039:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651889.121374:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651889.121399:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147585920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651889.121486:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651889.122345:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651889.122359:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147586048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651889.122402:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651889.122482:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147585920 00000100:00100000:2.0:1788651889.122491:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147585920 00000100:00100000:2.0:1788651889.122526:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147586048 00000100:00100000:2.0:1788651889.122529:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147586048 00000100:00100000:2.0:1788651889.122542:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788651889.122550:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147585920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788651889.122577:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651889.122620:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147585920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (1134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651889.122627:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788651889.122642:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788651889.122649:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147586048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788651889.122658:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651889.122709:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147586048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651889.122715:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00080000:2.0:1788651889.122759:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff51a300 x1875537147585920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1788651889.122773:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c37c5880 x1875537147586048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651905 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651889.122779:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147585920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651889.122798:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147586048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651890.144347:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147586176:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651890.144419:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651890.144602:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147586176 00000100:00100000:1.0:1788651890.144624:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147586176 00000100:00100000:1.0:1788651890.144677:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788651890.144686:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147586176:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651890.144721:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651890.144770:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147586176:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651890.144777:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788651890.144873:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147586176:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788651890.145429:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651891.168613:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651891.681409:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651891.681430:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147586304:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651891.681509:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651891.681745:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147586304 00000100:00100000:0.0:1788651891.681754:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147586304 00000100:00100000:0.0:1788651891.681805:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788651891.681813:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147586304:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788651891.681848:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788651891.681989:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147586304:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651891.681997:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788651891.682114:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147586304:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651891.877595:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651891.877754:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651891.877797:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651891.880566:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125472384 00000100:00100000:0.0:1788651891.880581:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125472384 00000100:00100000:0.0:1788651891.880660:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 378 00000100:00100000:0.0:1788651891.880670:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125472384:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651891.880751:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1289450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2391:x1875537125472384:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 82us (3165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651891.880758:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 378 00000100:00100000:3.0:1788651891.884690:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125472640 00000100:00100000:3.0:1788651891.884705:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125472640 00000100:00100000:3.0:1788651891.884789:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125472512 00000100:00100000:3.0:1788651891.884793:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125472512 00000100:00100000:3.0:1788651891.884824:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 260 00000100:00100000:3.0:1788651891.884835:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125472640:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651891.884941:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125472640:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 108us (7302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651891.884950:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 260 00000100:00100000:3.0:1788651891.884968:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 261 00000100:00100000:3.0:1788651891.884975:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125472512:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651891.885001:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2391:x1875537125472512:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 27us (7203us total) trans 0 rc 0/0 00000100:00080000:2.0:1788651891.885006:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651891.885008:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 261 00000100:00080000:2.0:1788651891.885013:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788651891.899745:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651891.900280:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651891.900388:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651891.900491:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125473024 00000100:00100000:0.0:1788651891.900501:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125473024 00000100:00100000:1.0:1788651891.900538:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125472896 00000100:00100000:1.0:1788651891.900545:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125472896 00000100:00100000:0.0:1788651891.900582:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 262 00000100:00080000:2.0:1788651891.900618:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788651891.900622:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788651891.900735:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125473024:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651891.900816:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125473024:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 225us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651891.905935:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125472768 00000100:00100000:3.0:1788651891.905950:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125472768 00000100:00100000:1.0:1788651891.909139:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 263 00000100:00100000:1.0:1788651891.909163:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125472896:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651891.909188:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 262 00000100:00100000:0.0:1788651891.909473:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2391:x1875537125472896:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 321us (9084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651891.909483:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 263 00000100:00100000:3.0:1788651891.909654:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 27 00000100:00100000:3.0:1788651891.909664:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2387:x1875537125472768:12345-192.168.204.45@tcp:9:kworker.0 00000020:00000080:3.0:1788651891.909685:0:8744:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3e23 00000100:00080000:3.0:1788651891.909695:0:8744:0:(import.c:65:import_set_state_nolock()) ffff8f86ff469000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788651891.909741:0:8744:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788651891.909864:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+2:2387:x1875537125472768:12345-192.168.204.45@tcp:9:kworker.0 Request processed in 202us (10128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651891.909871:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 27 00010000:00010000:3.0:1788651891.909888:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788651891.919118:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788651892.192113:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651893.216105:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651893.216161:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147586432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651893.216268:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651893.216348:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147586944:0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.216364:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147586816:0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.216381:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651893.216404:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147587456:0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.216412:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651893.216438:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147587328:0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.216442:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651893.216467:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147587968:0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.216485:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651893.216500:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651893.216511:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147587840:0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.216526:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788651893.216534:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147586560:0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.216555:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651893.216576:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651893.216585:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788651893.216594:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147586688:0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.216609:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147587072:0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.216623:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651893.216645:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147587200:0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.216655:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651893.216742:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147588096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651893.216810:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147586432 00000100:00100000:3.0:1788651893.216818:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147586432 00000100:00100000:3.0:1788651893.216882:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788651893.216892:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147586432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651893.216939:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651893.221780:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651893.223476:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147587712:0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.223889:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651893.223965:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147586944 00000100:00100000:1.0:1788651893.223988:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147586944 00000100:00100000:1.0:1788651893.224032:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147587328 00000100:00100000:1.0:1788651893.224035:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147587328 00000100:00100000:1.0:1788651893.224051:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147587840 00000100:00100000:1.0:1788651893.224054:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147587840 00000100:00100000:1.0:1788651893.224066:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147586688 00000100:00100000:1.0:1788651893.224069:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147586688 00000100:00100000:1.0:1788651893.224079:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147587200 00000100:00100000:1.0:1788651893.224082:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147587200 00000100:00100000:1.0:1788651893.224093:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147587712 00000100:00100000:1.0:1788651893.224096:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147587712 00000100:00100000:1.0:1788651893.224112:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788651893.224120:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147586944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.224189:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147586944:12345-0@lo:400:kworker.0 Request processed in 68us (7808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651893.224196:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788651893.224229:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788651893.224235:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147587328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.224280:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147587328:12345-0@lo:400:kworker.0 Request processed in 45us (7795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651893.224289:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788651893.224301:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788651893.224307:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147587840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.224337:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147587840:12345-0@lo:400:kworker.0 Request processed in 30us (7782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651893.224342:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788651893.224352:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788651893.224357:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147586688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.224397:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147586688:12345-0@lo:400:kworker.0 Request processed in 39us (7775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651893.224403:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788651893.224415:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788651893.224421:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147587200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.224447:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147587200:12345-0@lo:400:kworker.0 Request processed in 26us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651893.224452:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788651893.226732:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788651893.226753:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147587712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.226840:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147587712:12345-0@lo:400:kworker.0 Request processed in 96us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651893.226848:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788651893.226888:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147587456 00000100:00100000:1.0:1788651893.226896:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147587456 00000100:00100000:1.0:1788651893.226960:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147587968 00000100:00100000:1.0:1788651893.226964:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147587968 00000100:00100000:1.0:1788651893.226994:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788651893.227001:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147587456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.227039:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147587456:12345-0@lo:400:kworker.0 Request processed in 38us (10599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651893.227046:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788651893.227059:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788651893.227066:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147587968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.227094:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147587968:12345-0@lo:400:kworker.0 Request processed in 29us (10596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651893.227117:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788651893.227175:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147586688:0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.227189:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147587200:0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.227199:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147587712:0@lo:400:kworker.0 00010000:00080000:1.0:1788651893.227214:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c0380 x1875537147587328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651893.227225:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147587328:0@lo:400:kworker.0 00010000:00080000:1.0:1788651893.227237:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3731f80 x1875537147587840/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651893.227245:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147587840:0@lo:400:kworker.0 00000100:00100000:2.0:1788651893.229173:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788651893.229339:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651893.229345:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788651893.229348:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788651893.229350:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651893.229366:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147586816 00000100:00100000:2.0:1788651893.229375:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147586816 00000100:00100000:2.0:1788651893.229425:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147587072 00000100:00100000:2.0:1788651893.229428:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147587072 00000100:00100000:2.0:1788651893.229442:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788651893.229452:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147586816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651893.229516:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147586816:12345-0@lo:400:kworker.0 Request processed in 65us (13107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651893.229523:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788651893.229540:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788651893.229546:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147587072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651893.229592:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147587072:12345-0@lo:400:kworker.0 Request processed in 47us (12939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651893.229599:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788651893.229646:0:8431:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788651893.229655:0:8431:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788651893.235931:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147586560 00000100:00100000:1.0:1788651893.235945:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147586560 00000100:00100000:0.0:1788651893.235978:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147587072:0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.235996:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147587584:0@lo:400:kworker.0 00000100:00100000:1.0:1788651893.236011:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:1.0:1788651893.236024:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147586560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.236208:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651893.236389:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147586944:0@lo:400:kworker.0 00010000:00080000:0.0:1788651893.236405:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c1f80 x1875537147587456/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651893.236433:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147587456:0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.236448:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147587968:0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.236590:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147586816:0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.236747:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147587584 00000100:00100000:0.0:1788651893.236752:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147587584 00000100:00100000:0.0:1788651893.236825:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788651893.236834:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147587584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.237024:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147587584:12345-0@lo:400:kworker.0 Request processed in 191us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651893.237032:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788651893.237276:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651893.237293:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147588096 00000100:00100000:2.0:1788651893.237298:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147588096 00010000:00080000:0.0:1788651893.237483:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c35c2300 x1875537147587584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651909 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651893.237512:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147587584:0@lo:400:kworker.0 00000100:00100000:0.0:1788651893.237615:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788651893.237722:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147588096:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788651893.237742:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651893.237797:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147588096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 175us (8632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651893.237804:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788651893.238051:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147588096:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651893.240658:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147586432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 23757us (24381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651893.240675:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788651893.240808:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147586432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651893.245803:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1289850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147586560:12345-0@lo:400:kworker.0 Request processed in 9772us (29218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651893.245819:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788651893.252482:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147586560:0@lo:400:kworker.0 00010000:00010000:3.0:1788651894.241474:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651894.242031:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147588224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651894.242242:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651894.242380:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147588224 00000100:00100000:0.0:1788651894.242400:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147588224 00000100:00100000:0.0:1788651894.244162:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788651894.244179:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147588224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788651894.244211:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651894.244281:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147588224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651894.244288:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788651894.244472:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147588352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651894.244512:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788651894.249329:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a5b480 x1875537147588224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651894.249360:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147588224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651894.260229:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147588352 00000100:00100000:3.0:1788651894.260247:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147588352 00000100:00100000:3.0:1788651894.260353:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788651894.260364:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147588352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651894.260392:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651894.260684:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147588352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 321us (16170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651894.260692:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00010000:00080000:1.0:1788651894.260725:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a52680 x1875537147588352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651910 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651894.260750:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147588352:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788651895.264192:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651895.266467:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651895.266491:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147588480:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788651895.266557:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651895.266620:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147588480 00000100:00100000:1.0:1788651895.266627:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147588480 00000100:00100000:1.0:1788651895.266673:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788651895.266682:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147588480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651895.266714:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651895.266760:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147588480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651895.266768:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788651895.266810:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147588480:0@lo:41:osp-pre-1-0.0 00000040:00080000:0.0:1788651895.840534:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788651895.905753:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788651896.288602:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651896.812259:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147588608:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651896.812336:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651896.813928:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147588608 00000100:00100000:3.0:1788651896.813942:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147588608 00000100:00100000:3.0:1788651896.814001:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788651896.814011:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147588608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788651896.814044:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788651896.820957:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147588608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 6934us (8606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651896.820972:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788651896.822246:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147588608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651897.008615:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651897.008652:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651897.008700:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651897.008724:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651897.008748:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651897.008782:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125473408 00000100:00100000:0.0:1788651897.008791:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125473408 00000100:00100000:0.0:1788651897.008846:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125473664 00000100:00100000:0.0:1788651897.008850:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125473664 00000100:00100000:0.0:1788651897.008863:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125473280 00000100:00100000:0.0:1788651897.008865:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125473280 00000100:00100000:0.0:1788651897.008875:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125473536 00000100:00100000:0.0:1788651897.008877:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125473536 00000100:00100000:0.0:1788651897.008891:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 270 00000100:00100000:0.0:1788651897.008900:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125473408:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651897.009007:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125473408:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 106us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651897.009015:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 270 00000100:00100000:0.0:1788651897.009035:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 271 00000100:00100000:0.0:1788651897.009050:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125473664:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651897.009089:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125473664:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 39us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651897.009095:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 271 00000100:00100000:0.0:1788651897.009108:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 272 00000100:00100000:0.0:1788651897.009115:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125473280:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651897.009150:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125473280:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 35us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651897.009157:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 272 00000100:00100000:0.0:1788651897.009169:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 273 00000100:00100000:0.0:1788651897.009175:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125473536:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651897.009196:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125473536:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 22us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651897.009202:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 273 00000100:00080000:0.0:1788651897.009228:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651897.009232:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651897.009796:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125473152 00000100:00100000:3.0:1788651897.009802:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125473152 00000100:00100000:3.0:1788651897.009843:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 380 00000100:00100000:3.0:1788651897.009850:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125473152:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651897.009887:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125473152:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 37us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651897.009893:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 380 00010000:00010000:1.0:1788651897.313172:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788651897.831878:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:2.0:1788651897.831888:0:9506:0:(genops.c:885:class_export_put()) final put ffff8f86ff46b800/72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:1.0:1788651897.838942:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ff46b800/72121fb7-fb91-4477-92d5-4e7fe3e6b65d for lustre-OST0001 00000020:00000080:1.0:1788651897.839021:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86ff469000 for lustre-OST0001 00000100:00100000:2.0:1788651898.336070:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147588736:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651898.336146:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651898.336243:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651898.336301:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147588736 00000100:00100000:2.0:1788651898.336309:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147588736 00000100:00100000:2.0:1788651898.336364:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788651898.336373:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147588736:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651898.336401:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651898.336444:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147588736:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651898.336459:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:2.0:1788651898.336479:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651898.336559:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147588736:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788651898.337297:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651898.337310:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147588864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651898.337350:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651898.337698:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147588864 00000100:00100000:3.0:1788651898.337705:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147588864 00000100:00100000:3.0:1788651898.337745:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788651898.337753:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147588864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651898.337771:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651898.337810:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147588864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651898.337817:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788651898.338285:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147588864:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788651898.339754:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651898.344015:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147588992:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344099:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651898.344141:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147589504:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344174:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651898.344192:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147590016:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344215:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651898.344241:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788651898.344247:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147589120:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344270:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651898.344285:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147589632:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344315:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651898.344333:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147590144:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344353:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651898.344399:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147588992 00000100:00100000:0.0:1788651898.344407:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147588992 00000100:00100000:0.0:1788651898.344452:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788651898.344461:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147588992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344512:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1288450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147588992:12345-0@lo:400:kworker.0 Request processed in 52us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651898.344519:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1788651898.344553:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147589504 00000100:00100000:0.0:1788651898.344557:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147589504 00000100:00100000:0.0:1788651898.344582:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788651898.344589:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147589504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344622:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147589504:12345-0@lo:400:kworker.0 Request processed in 33us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651898.344629:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788651898.344646:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147589120 00000100:00100000:0.0:1788651898.344649:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147589120 00000100:00100000:0.0:1788651898.344680:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147589632 00000100:00100000:0.0:1788651898.344683:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147589632 00000100:00100000:0.0:1788651898.344705:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147590144 00000100:00100000:0.0:1788651898.344708:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147590144 00000100:00100000:0.0:1788651898.344721:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788651898.344726:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147589120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344756:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147589120:12345-0@lo:400:kworker.0 Request processed in 30us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651898.344763:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788651898.344775:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788651898.344782:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147589632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344807:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147589632:12345-0@lo:400:kworker.0 Request processed in 26us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651898.344813:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788651898.344823:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788651898.344829:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147590144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344853:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147590144:12345-0@lo:400:kworker.0 Request processed in 24us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651898.344859:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1788651898.344894:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147589248:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344947:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651898.344965:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147589760:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.344984:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651898.344998:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147590272:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345016:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651898.345032:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788651898.345058:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147589376:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345082:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651898.345096:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147589888:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345114:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651898.345136:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147589248 00000100:00100000:0.0:1788651898.345140:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147589248 00000100:00100000:0.0:1788651898.345161:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788651898.345166:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147589248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345198:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147589248:12345-0@lo:400:kworker.0 Request processed in 31us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651898.345203:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788651898.345218:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147590016 00000100:00100000:0.0:1788651898.345221:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147590016 00000100:00100000:0.0:1788651898.345241:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147589888 00000100:00100000:0.0:1788651898.345244:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147589888 00000100:00100000:0.0:1788651898.345258:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788651898.345264:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147590016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345290:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147590016:12345-0@lo:400:kworker.0 Request processed in 26us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651898.345296:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788651898.345307:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788651898.345312:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147589888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345334:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147589888:12345-0@lo:400:kworker.0 Request processed in 22us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651898.345339:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788651898.345360:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147589760 00000100:00100000:0.0:1788651898.345363:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147589760 00000100:00100000:0.0:1788651898.345389:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147590272 00000100:00100000:0.0:1788651898.345393:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147590272 00000100:00100000:0.0:1788651898.345407:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147589376 00000100:00100000:0.0:1788651898.345409:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147589376 00000100:00100000:0.0:1788651898.345422:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788651898.345427:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147589760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345455:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147589760:12345-0@lo:400:kworker.0 Request processed in 27us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651898.345461:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788651898.345473:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788651898.345478:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147590272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345502:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147590272:12345-0@lo:400:kworker.0 Request processed in 25us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651898.345508:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788651898.345518:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788651898.345523:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147589376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345547:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147589376:12345-0@lo:400:kworker.0 Request processed in 24us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651898.345553:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788651898.345597:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147589120:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345609:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147589632:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345618:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147590144:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345626:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147588992:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345635:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147589504:0@lo:400:kworker.0 00010000:00080000:0.0:1788651898.345658:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c369d880 x1875537147590016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651898.345668:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147590016:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345713:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147589376:0@lo:400:kworker.0 00010000:00080000:0.0:1788651898.345722:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c369df80 x1875537147589888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651898.345731:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147589888:0@lo:400:kworker.0 00000100:00100000:0.0:1788651898.345740:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147589248:0@lo:400:kworker.0 00010000:00080000:0.0:1788651898.345748:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c369c380 x1875537147589760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651898.345757:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147589760:0@lo:400:kworker.0 00010000:00080000:0.0:1788651898.345765:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c369ce00 x1875537147590272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651914 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651898.345773:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147590272:0@lo:400:kworker.0 00000100:00080000:2.0:1788651898.346078:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788651898.346083:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651898.346085:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788651899.360114:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651899.360156:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651899.360181:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147590400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651899.360252:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651899.360798:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147590400 00000100:00100000:3.0:1788651899.360810:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147590400 00000100:00100000:3.0:1788651899.360868:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788651899.360878:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147590400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651899.360933:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651899.361009:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147590400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651899.361016:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00010000:00080000:1.0:1788651899.362057:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c2a52d80 x1875537147590400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651899.362082:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147590400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651899.363251:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147590528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651899.363316:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651899.363414:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147590528 00000100:00100000:0.0:1788651899.363421:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147590528 00000100:00100000:0.0:1788651899.363468:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788651899.363476:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147590528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788651899.363522:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651899.363576:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147590528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 100us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651899.363583:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00010000:00080000:1.0:1788651899.363714:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3712300 x1875537147590528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651915 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651899.363731:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147590528:0@lo:13:osp-pre-0-1.0 00000001:02000400:2.0:1788651900.379337:0:14053:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 19:44:58 (1788651898) 00010000:00010000:1.0:1788651900.384189:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651900.384341:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147590656:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651900.384421:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651900.385056:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147590656 00000100:00100000:1.0:1788651900.385069:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147590656 00000100:00100000:1.0:1788651900.385152:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788651900.385162:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147590656:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651900.385205:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651900.393342:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147590656:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8167us (8906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651900.393359:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788651900.398303:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147590656:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788651901.408294:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651901.920325:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147590784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651901.920402:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651901.920472:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147590784 00000100:00100000:1.0:1788651901.920481:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147590784 00000100:00100000:1.0:1788651901.920547:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788651901.920558:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147590784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651901.920592:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788651901.920651:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147590784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651901.920659:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788651901.920704:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147590784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651902.119045:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651902.119081:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651902.119112:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651902.119131:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651902.119153:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651902.119178:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125474048 00000100:00100000:0.0:1788651902.119187:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125474048 00000100:00100000:0.0:1788651902.119239:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125474304 00000100:00100000:0.0:1788651902.119242:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125474304 00000100:00100000:0.0:1788651902.119255:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125473920 00000100:00100000:0.0:1788651902.119258:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125473920 00000100:00100000:0.0:1788651902.119269:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125474176 00000100:00100000:0.0:1788651902.119271:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125474176 00000100:00100000:0.0:1788651902.119298:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 280 00000100:00100000:0.0:1788651902.119308:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125474048:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651902.119380:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125474048:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 72us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651902.119387:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 280 00000100:00100000:0.0:1788651902.119406:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 281 00000100:00100000:0.0:1788651902.119413:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125474304:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651902.119453:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125474304:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 41us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651902.119460:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 281 00000100:00100000:0.0:1788651902.119473:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 282 00000100:00100000:0.0:1788651902.119478:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125473920:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651902.119503:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125473920:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 24us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651902.119508:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 282 00000100:00100000:0.0:1788651902.119519:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 283 00000100:00100000:0.0:1788651902.119526:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125474176:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651902.119546:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125474176:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 22us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651902.119551:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 283 00000100:00100000:1.0:1788651902.119750:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125473792 00000100:00100000:1.0:1788651902.119755:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125473792 00000100:00100000:1.0:1788651902.119793:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 382 00000100:00100000:1.0:1788651902.119800:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125473792:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651902.119833:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125473792:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 34us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651902.119839:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 382 00000100:00080000:2.0:1788651902.121545:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788651902.121554:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788651902.246966:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651902.247141:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125474432 00000100:00100000:2.0:1788651902.247151:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125474432 00000100:00100000:2.0:1788651902.247208:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 40 00000100:00100000:2.0:1788651902.247218:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:11085:x1875537125474432:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651902.247237:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651902.247259:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3f03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c0a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651902.247326:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3f0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651902.247341:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651902.247371:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651902.247495:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788651902.247500:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651902.247540:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3f0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651902.247636:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c3f03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c0a expref: 7 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651902.247655:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3f0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c0a expref: 6 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651902.247724:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:2.0:1788651902.247728:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651902.247732:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc000, rc 0) 00000100:00100000:2.0:1788651902.248572:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:11085:x1875537125474432:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 1352us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651902.248581:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 40 00000100:00100000:3.0:1788651902.270692:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651902.270800:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125474560 00000100:00100000:0.0:1788651902.270811:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125474560 00000100:00100000:0.0:1788651902.270879:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 41 00000100:00100000:0.0:1788651902.270889:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:11086:x1875537125474560:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651902.270937:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651902.270959:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c3f11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c11 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271039:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5800/0xcd2f56ea038c3f18 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271073:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5800/0xcd2f56ea038c3f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271084:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5800/0xcd2f56ea038c3f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271101:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c3f1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271108:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c3f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271114:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c3f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271176:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c3f26 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271185:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c3f26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271191:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c3f26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651902.271229:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788651902.271233:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788651902.271253:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c3f26 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271264:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5800/0xcd2f56ea038c3f18 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271279:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5800/0xcd2f56ea038c3f18 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271297:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5800/0xcd2f56ea038c3f18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271303:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651902.271307:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5800/0xcd2f56ea038c3f18 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271314:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5800/0xcd2f56ea038c3f18 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271326:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:0.0:1788651902.271329:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651902.271333:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5800/0xcd2f56ea038c3f18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271339:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5800/0xcd2f56ea038c3f18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271353:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c3f1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271358:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c3f1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271363:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c3f1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271367:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651902.271376:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c3f1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271384:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c3f1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271392:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f85c3352000) 00010000:00010000:0.0:1788651902.271394:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651902.271397:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c3f1f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271403:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c3f1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271434:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c3f11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c11 expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271446:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c3f26 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c11 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651902.271454:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f85c3352f00) 00010000:00010000:0.0:1788651902.271456:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651902.271458:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5200, rc 0) 00000100:00100000:0.0:1788651902.271529:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:11086:x1875537125474560:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 641us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651902.271537:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 41 00000100:00100000:1.0:1788651902.275730:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651902.275874:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125474688 00000100:00100000:3.0:1788651902.275894:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125474688 00000100:00100000:3.0:1788651902.275992:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:0.0:1788651902.276001:0:6521:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:3.0:1788651902.276004:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:11086:x1875537125474688:12345-192.168.204.45@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788651902.276015:0:6521:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00000100:00100000:3.0:1788651902.276241:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:11086:x1875537125474688:12345-192.168.204.45@tcp:900:lhsmtool_posix.0 Request processed in 239us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651902.276251:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:1.0:1788651902.289953:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651902.290412:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125474944 00000100:00100000:3.0:1788651902.290424:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125474944 00000100:00100000:3.0:1788651902.290488:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 42 00000100:00100000:3.0:1788651902.290497:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:11086:x1875537125474944:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651902.290522:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651902.290543:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c18 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.290638:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f34 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.290652:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.290664:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.290722:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.290729:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.290735:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.290851:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3f42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.290860:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.290866:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651902.290875:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788651902.291264:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291389:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f34 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291397:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291403:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dce00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651902.291407:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291415:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f34 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291427:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f85c3352f00) 00010000:00010000:3.0:1788651902.291430:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651902.291435:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291441:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291458:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291463:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f3b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291469:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291473:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dc200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651902.291482:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291489:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f3b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291497:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f86f55f6f00) 00010000:00010000:3.0:1788651902.291499:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651902.291502:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f3b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291508:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291799:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c18 expref: 10 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291817:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3f42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c18 expref: 9 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651902.291824:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:3.0:1788651902.291826:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651902.291828:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dd400, rc 0) 00000100:00100000:3.0:1788651902.291933:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:11086:x1875537125474944:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 1410us (1965us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788651902.291941:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 42 00000100:00100000:0.0:1788651902.295868:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651902.298927:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125475072 00000100:00100000:2.0:1788651902.298942:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125475072 00000100:00100000:2.0:1788651902.299182:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 43 00000100:00100000:2.0:1788651902.299193:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:11086:x1875537125475072:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788651902.303734:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:11086:x1875537125475072:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 Request processed in 4528us (7863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651902.303749:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 43 00000100:00100000:1.0:1788651902.307528:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651902.308419:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125475200 00000100:00100000:2.0:1788651902.308431:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125475200 00000100:00100000:2.0:1788651902.308496:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 44 00000100:00100000:2.0:1788651902.308506:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:11086:x1875537125475200:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788651902.309948:0:6509:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1400us 00000100:00100000:2.0:1788651902.332439:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:11086:x1875537125475200:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 Request processed in 23926us (24914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651902.332453:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 44 00010000:00010000:2.0:1788651902.433285:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788651903.008593:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788651903.075115:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788651903.457387:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147591296:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.457459:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.457514:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147591808:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.457562:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.457589:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147592320:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.457614:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.457641:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788651903.457647:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147590912:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.457676:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.457697:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147591424:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.457720:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.457737:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147591936:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.457757:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.457772:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147592448:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.457792:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.457818:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147591040:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.457840:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.457858:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147591552:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.457879:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.457901:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147592064:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.457966:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.457986:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788651903.457993:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147591168:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.458028:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.458048:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147591680:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.459032:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.459291:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147592192:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.459325:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651903.459363:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147591808 00000100:00100000:0.0:1788651903.459371:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147591808 00000100:00100000:0.0:1788651903.459427:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147592320 00000100:00100000:0.0:1788651903.459430:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147592320 00000100:00100000:0.0:1788651903.459442:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147591936 00000100:00100000:0.0:1788651903.459444:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147591936 00000100:00100000:0.0:1788651903.459455:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147592448 00000100:00100000:0.0:1788651903.459457:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147592448 00000100:00100000:0.0:1788651903.459472:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788651903.459480:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147591808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.459539:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147591808:12345-0@lo:400:kworker.0 Request processed in 60us (1977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651903.459546:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788651903.459563:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788651903.459570:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147592320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.459597:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147592320:12345-0@lo:400:kworker.0 Request processed in 28us (1983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651903.459603:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788651903.459614:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788651903.459620:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147591936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.459646:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147591936:12345-0@lo:400:kworker.0 Request processed in 27us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651903.459666:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788651903.459679:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788651903.459685:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147592448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.459714:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147592448:12345-0@lo:400:kworker.0 Request processed in 29us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651903.459719:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788651903.459743:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147590912 00000100:00100000:0.0:1788651903.459748:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147590912 00000100:00100000:0.0:1788651903.459776:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788651903.459782:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147590912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.459811:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d128a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147590912:12345-0@lo:400:kworker.0 Request processed in 29us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651903.459817:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788651903.459843:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147591424 00000100:00100000:0.0:1788651903.459846:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147591424 00000100:00100000:0.0:1788651903.459870:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147591168 00000100:00100000:0.0:1788651903.459872:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147591168 00000100:00100000:0.0:1788651903.459884:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788651903.459889:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147591424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651903.465881:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147591296 00000100:00100000:1.0:1788651903.465896:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147591296 00000100:00100000:1.0:1788651903.465978:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147591040 00000100:00100000:1.0:1788651903.465996:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147591040 00000100:00100000:1.0:1788651903.466013:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147591552 00000100:00100000:1.0:1788651903.466015:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147591552 00000100:00100000:1.0:1788651903.466033:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147592064 00000100:00100000:1.0:1788651903.466035:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147592064 00000100:00100000:1.0:1788651903.466048:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147591680 00000100:00100000:1.0:1788651903.466052:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147591680 00000100:00100000:1.0:1788651903.466193:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147592192 00000100:00100000:1.0:1788651903.466197:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147592192 00000100:00100000:1.0:1788651903.466231:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788651903.466241:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147591296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651903.466334:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147591296:12345-0@lo:400:kworker.0 Request processed in 95us (8875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651903.466342:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788651903.466362:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788651903.466369:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147591040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.468016:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147591424:12345-0@lo:400:kworker.0 Request processed in 8117us (10286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651903.468030:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788651903.469022:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788651903.469041:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147591168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651903.469208:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147592704:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651903.469263:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651903.469321:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651903.469329:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147592576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651903.469355:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651903.469389:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788651903.469398:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147591552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651903.472552:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147591040:12345-0@lo:400:kworker.0 Request processed in 6174us (14700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651903.472566:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788651903.472605:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788651903.472624:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147592064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651903.472697:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147592064:12345-0@lo:400:kworker.0 Request processed in 84us (14735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651903.472703:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788651903.472716:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788651903.472722:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147591680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651903.472757:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147591680:12345-0@lo:400:kworker.0 Request processed in 36us (13727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651903.472781:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788651903.472799:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788651903.472807:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147592192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651903.472937:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147592192:12345-0@lo:400:kworker.0 Request processed in 131us (13611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651903.472943:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788651903.473208:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147591168:12345-0@lo:400:kworker.0 Request processed in 4173us (15175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651903.473229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:0.0:1788651903.473258:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651903.473264:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651903.473268:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651903.473274:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651903.473312:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147590912:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.473332:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147591424:0@lo:400:kworker.0 00010000:00080000:0.0:1788651903.473347:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c369d880 x1875537147591936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651903.473358:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147591936:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.473371:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147592448:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.473383:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147591296:0@lo:400:kworker.0 00010000:00080000:0.0:1788651903.473396:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c369f480 x1875537147591808/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788651919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651903.473473:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147591808:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.473492:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147592320:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.473557:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147591168:0@lo:400:kworker.0 00010000:00080000:0.0:1788651903.473571:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c369df80 x1875537147591680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651903.473580:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147591680:0@lo:400:kworker.0 00010000:00080000:0.0:1788651903.473590:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c369ca80 x1875537147592192/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651903.473607:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147592192:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.473623:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147591040:0@lo:400:kworker.0 00000100:00100000:3.0:1788651903.473687:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147591552:12345-0@lo:400:kworker.0 Request processed in 4289us (15806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651903.473695:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788651903.473733:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147592704 00000100:00100000:3.0:1788651903.473740:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147592704 00000100:00100000:3.0:1788651903.473904:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147592576 00000100:00100000:3.0:1788651903.473925:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147592576 00000100:00100000:0.0:1788651903.473992:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147591552:0@lo:400:kworker.0 00000100:00100000:0.0:1788651903.474003:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147592064:0@lo:400:kworker.0 00010000:00010000:0.0:1788651903.474079:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651903.474199:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788651903.474209:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147592704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788651903.474535:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651903.474634:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147592704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 426us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651903.474641:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788651903.474658:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788651903.474667:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147592576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651903.474678:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651903.474705:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147592576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 41us (5349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651903.474711:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788651903.474901:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147592704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788651903.475037:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147592576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788651904.483023:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651904.483230:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147592832:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651904.483298:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651904.483405:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147592832 00000100:00100000:2.0:1788651904.483413:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147592832 00000100:00100000:2.0:1788651904.483464:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788651904.483475:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147592832:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788651904.483502:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651904.483546:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147592832:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651904.483554:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00080000:1.0:1788651904.483625:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeb10a80 x1875537147592832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651904.483644:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147592832:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651904.484303:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651904.484315:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147592960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651904.484356:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651904.489043:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147592960 00000100:00100000:0.0:1788651904.489063:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147592960 00000100:00100000:0.0:1788651904.490344:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788651904.490361:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147592960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651904.490388:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651904.490478:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147592960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (6120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651904.490485:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:2.0:1788651904.490566:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff519500 x1875537147592960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788651920 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651904.490588:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147592960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651904.862261:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651904.862352:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125475328 00000100:00100000:0.0:1788651904.862364:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125475328 00000100:00100000:0.0:1788651904.862449:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 45 00000100:00100000:0.0:1788651904.862463:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:11128:x1875537125475328:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651904.862488:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651904.862513:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c3f50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c1f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862597:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862613:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862623:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862638:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862645:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862651:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862695:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862702:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862708:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862713:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651904.862718:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862736:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862749:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:0.0:1788651904.862754:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651904.862758:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862765:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862779:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862785:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862791:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862795:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651904.862798:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862803:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862810:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f85c3352d00) 00010000:00010000:0.0:1788651904.862812:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651904.862815:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862829:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862864:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c3f50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c1f expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862874:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:0.0:1788651904.862876:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651904.862879:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c3f50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c1f expref: 10 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651904.862889:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96000, rc 0) 00000100:00100000:0.0:1788651904.862988:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:11128:x1875537125475328:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 529us (740us total) trans 0 rc 301/301 00000100:00100000:0.0:1788651904.862996:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 45 00000100:00080000:3.0:1788651904.863186:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651904.873234:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651904.873459:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125475584 00000100:00100000:3.0:1788651904.873470:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125475584 00000100:00100000:3.0:1788651904.873539:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:3.0:1788651904.873549:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:11128:x1875537125475584:12345-192.168.204.45@tcp:36:lfs.0 00010000:00010000:3.0:1788651904.873613:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651904.873639:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c3f0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c0a expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.873655:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c2857500) 00010000:00010000:3.0:1788651904.873666:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651904.873725:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.873740:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.873768:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.873780:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.873787:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.873793:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.880652:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.880681:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.880694:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651904.880716:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e508bcf7 reply state 0000000074b80cdd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.880729:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.880737:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:3.0:1788651904.880740:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788651904.880745:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788651904.880751:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788651904.880759:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.880777:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f65 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.880785:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.880791:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dcc00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651904.880796:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.880804:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f65 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.880814:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:3.0:1788651904.880817:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651904.880821:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f65 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.880827:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f65 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651904.880992:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e508bcf7 reply state 0000000074b80cdd transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.881004:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651904.881011:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f85c3368000) 00010000:00010000:3.0:1788651904.881013:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788651904.881016:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1788651904.881145:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:11128:x1875537125475584:12345-192.168.204.45@tcp:36:lfs.0 Request processed in 7592us (7920us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788651904.881161:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:0.0:1788651904.999531:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651905.001026:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125475712 00000100:00100000:3.0:1788651905.001039:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125475712 00000100:00100000:3.0:1788651905.001113:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:3.0:1788651905.001124:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:11136:x1875537125475712:12345-192.168.204.45@tcp:101:lctl.0 00010000:00010000:3.0:1788651905.001152:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651905.001176:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c26 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.001254:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3f81 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.001269:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3f81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.001281:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3f81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651905.001325:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788651905.001329:0:10110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788651905.001370:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3f81 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.001395:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3f7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c26 expref: 12 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.001414:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3f81 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c26 expref: 11 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.001444:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:3.0:1788651905.001448:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651905.001452:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dd200, rc 0) 00000100:00100000:3.0:1788651905.001515:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:11136:x1875537125475712:12345-192.168.204.45@tcp:101:lctl.0 Request processed in 392us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651905.001522:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 47 00000040:00080000:0.0:1788651905.056774:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788651905.087535:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651905.087786:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125475840 00000100:00100000:0.0:1788651905.087797:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125475840 00000100:00100000:0.0:1788651905.087868:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 48 00000100:00100000:0.0:1788651905.087879:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:11142:x1875537125475840:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788651905.087900:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651905.087968:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c2d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088041:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088070:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088085:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088097:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c3f96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088105:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c3f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088111:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c3f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088200:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c3f9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088210:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c3f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088217:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c3f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651905.088252:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:0.0:1788651905.088257:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788651905.088291:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c3f9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088303:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088319:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f8f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088325:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088330:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651905.088335:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088344:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088357:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:0.0:1788651905.088360:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651905.088365:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088370:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c3f8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088383:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c3f96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088388:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c3f96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088393:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c3f96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088397:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651905.088405:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c3f96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088410:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c3f96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088416:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f85c3368000) 00010000:00010000:0.0:1788651905.088419:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651905.088421:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c3f96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088427:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c3f96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088453:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c3f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c2d expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088466:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c3f9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c2d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.088473:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:0.0:1788651905.088476:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788651905.088478:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97c00, rc 0) 00000100:00100000:0.0:1788651905.088550:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+12:11142:x1875537125475840:12345-192.168.204.45@tcp:101:bash.0 Request processed in 672us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651905.088557:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 48 00000100:00100000:0.0:1788651905.094365:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651905.095642:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125476096 00000100:00100000:3.0:1788651905.095656:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125476096 00000100:00100000:3.0:1788651905.095719:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 49 00000100:00100000:3.0:1788651905.095730:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+12:11142:x1875537125476096:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:3.0:1788651905.095753:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651905.095785:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3fa4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c34 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.095901:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.096273:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.096287:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.096323:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.096332:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.096359:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788651905.097169:0:6511:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788651905.097304:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3fb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.097315:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.097324:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3fb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.097356:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.100687:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.100710:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.100716:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dc400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651905.100965:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.100976:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.100997:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:3.0:1788651905.101000:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651905.101024:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fab lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.101031:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651905.101048:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000048e840c reply state 000000002f7db7d8 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.101061:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.101068:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3368500) 00010000:00010000:3.0:1788651905.101070:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788651905.101073:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788651905.101125:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3fa4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c34 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.101139:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c34 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.101147:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368f00) 00010000:00010000:3.0:1788651905.101149:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651905.101152:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dda00, rc 0) 00000100:00100000:3.0:1788651905.101291:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11142:x1875537125476096:12345-192.168.204.45@tcp:101:bash.0 Request processed in 5561us (6934us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788651905.101300:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 49 00000100:00100000:1.0:1788651905.111064:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651905.111167:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125476224 00000100:00100000:0.0:1788651905.111177:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125476224 00000100:00100000:0.0:1788651905.111234:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:0.0:1788651905.111262:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2387:x1875537125476224:12345-192.168.204.45@tcp:8:bash.0 00010000:00080000:0.0:1788651905.111302:0:8427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp t0 exp 0000000000000000 cur 361 last 0 00000020:00000080:0.0:1788651905.111339:0:8427:0:(genops.c:1385:class_connect()) connect: client 72121fb7-fb91-4477-92d5-4e7fe3e6b65d, cookie 0xcd2f56ea038c3fc7 00002000:00100000:0.0:1788651905.111353:0:8427:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 72121fb7-fb91-4477-92d5-4e7fe3e6b65d/ffff8f85c373f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788651905.111364:0:8427:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788651905.111447:0:8427:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788651905.111477:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8f85c373b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788651905.111559:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2387:x1875537125476224:12345-192.168.204.45@tcp:8:bash.0 Request processed in 298us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651905.111567:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:2.0:1788651905.119147:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651905.119464:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125476352 00000100:00100000:1.0:1788651905.119475:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125476352 00000100:00100000:1.0:1788651905.119558:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:1.0:1788651905.119568:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:0:x1875537125476352:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:1.0:1788651905.119585:0:8744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651905.119608:0:8744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007f90457/0xcd2f56ea038c3fce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c3b expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788651905.119635:0:8744:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788651905.119654:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1788651905.119659:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651905.119669:0:8744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007f90457/0xcd2f56ea038c3fce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c3b expref: 7 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.119687:0:8744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000007f90457/0xcd2f56ea038c3fce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c3b expref: 7 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.119701:0:8744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415000, rc 0) 00000100:00100000:1.0:1788651905.119779:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:0:x1875537125476352:12345-192.168.204.45@tcp:101:bash.0 Request processed in 212us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651905.119786:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00080000:3.0:1788651905.127569:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651905.127801:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651905.127997:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125476480 00000100:00100000:1.0:1788651905.128007:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125476480 00000100:00100000:1.0:1788651905.128064:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 30 00000100:00100000:1.0:1788651905.128074:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:11142:x1875537125476480:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:1.0:1788651905.128108:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651905.128127:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c42 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.128159:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007f90457/0xcd2f56ea038c3fce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c3b expref: 8 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.128168:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651905.128172:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651905.128177:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.128211:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007f90457/0xcd2f56ea038c3fce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c3b expref: 8 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.128225:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007f90457/0xcd2f56ea038c3fce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c3b expref: 8 pid: 8744 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651905.128252:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1875537147593088:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651905.128346:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ee600 going to sleep for 11 seconds 00000100:00100000:1.0:1788651905.131059:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1875537147593088:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651905.131096:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 8 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.131117:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414e00, rc 0) 00000100:00100000:1.0:1788651905.131201:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:11142:x1875537125476480:12345-192.168.204.45@tcp:101:bash.0 Request processed in 3126us (3404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651905.131210:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 30 00000100:00100000:3.0:1788651905.133209:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651905.133984:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125476608 00000100:00100000:0.0:1788651905.133998:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125476608 00010000:00010000:0.0:1788651905.134051:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007f90457/0xcd2f56ea038c3fce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c3b expref: 8 pid: 8744 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651905.134099:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 52 00000100:00100000:0.0:1788651905.134110:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125476608:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651905.134128:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651905.134153:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007f90457/0xcd2f56ea038c3fce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c3b expref: 8 pid: 8744 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.134168:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007f90457/0xcd2f56ea038c3fce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c3b expref: 8 pid: 8744 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.134216:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007f90457/0xcd2f56ea038c3fce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c3b expref: 8 pid: 8744 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.134248:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651905.134253:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651905.134261:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.134270:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.134311:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651905.134325:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6497:1875537147593216:192.168.204.45@tcp:105: 00000100:00100000:0.0:1788651905.134414:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651905.136470:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbdc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6497:1875537147593216:192.168.204.45@tcp:105: 00010000:00010000:3.0:1788651905.136506:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651905.136562:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125476608:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 2453us (3362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651905.136572:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 52 00000040:00080000:2.0:1788651905.136742:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788651905.140413:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651905.140499:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125476864 00000100:00100000:3.0:1788651905.140509:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125476864 00000100:00100000:3.0:1788651905.140569:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:3.0:1788651905.140580:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11142:x1875537125476864:12345-192.168.204.45@tcp:35:bash.0 00000100:00100000:2.0:1788651905.142337:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11142:x1875537125476864:12345-192.168.204.45@tcp:35:bash.0 Request processed in 1750us (1923us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788651905.142363:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:0.0:1788651905.265249:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651905.265396:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125477120 00000100:00100000:3.0:1788651905.265407:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125477120 00000100:00100000:3.0:1788651905.265473:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 50 00000100:00100000:3.0:1788651905.265484:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11152:x1875537125477120:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651905.265510:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651905.265531:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3fdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c49 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651905.265635:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1788651905.265746:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3fdc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c49 expref: 18 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.265762:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:3.0:1788651905.265765:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651905.265770:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3fdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c49 expref: 18 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.265787:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dcc00, rc 0) 00000100:00100000:3.0:1788651905.265849:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:11152:x1875537125477120:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 366us (621us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1788651905.265870:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 50 00000100:00100000:3.0:1788651905.274896:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651905.276818:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125477376 00000100:00100000:1.0:1788651905.276848:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125477376 00000100:00100000:1.0:1788651905.276980:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:1.0:1788651905.276993:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:11152:x1875537125477376:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:1.0:1788651905.277280:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:11152:x1875537125477376:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 290us (2398us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788651905.277289:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:1.0:1788651905.414870:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651905.415059:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125477504 00000100:00100000:2.0:1788651905.415070:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125477504 00000100:00100000:2.0:1788651905.415132:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 51 00000100:00100000:2.0:1788651905.415143:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:11158:x1875537125477504:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651905.415167:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651905.415187:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3fea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c50 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.415269:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3ff1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.415285:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.415307:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651905.415362:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788651905.415366:0:12192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651905.415391:0:12192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.415415:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c3fea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c50 expref: 20 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.415444:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c50 expref: 19 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.415472:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651905.415475:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651905.415479:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd200, rc 0) 00000100:00100000:2.0:1788651905.415539:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:11158:x1875537125477504:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 397us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651905.415546:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 51 00000100:00100000:0.0:1788651905.418835:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651905.419021:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125477760 00000100:00100000:3.0:1788651905.419031:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125477760 00000100:00100000:3.0:1788651905.419091:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 52 00000100:00100000:3.0:1788651905.419101:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:11158:x1875537125477760:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651905.419120:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651905.419139:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3ff8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c57 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.419247:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.419261:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.419274:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651905.419298:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788651905.419570:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dcc00/0xcd2f56ea038c3ff8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c57 expref: 22 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.419591:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c57 expref: 21 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.419600:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368f00) 00010000:00010000:3.0:1788651905.419603:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651905.419620:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c29dc400, rc 0) 00000100:00100000:3.0:1788651905.419684:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:11158:x1875537125477760:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 584us (857us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788651905.419691:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 52 00000100:00100000:3.0:1788651905.422723:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651905.422815:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125478016 00000100:00100000:0.0:1788651905.422825:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125478016 00000100:00100000:0.0:1788651905.422895:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:0.0:1788651905.422949:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:11158:x1875537125478016:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651905.422976:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651905.422998:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c400d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c5e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.423119:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4014 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.423134:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4014 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.423146:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4014 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651905.423158:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788651905.423279:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c400d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c5e expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.423628:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4014 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c5e expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.423637:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368f00) 00010000:00010000:0.0:1788651905.423640:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788651905.423643:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96400, rc 0) 00000100:00100000:0.0:1788651905.423708:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:11158:x1875537125478016:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 805us (994us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1788651905.423715:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:3.0:1788651905.424057:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651905.424715:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125478144 00000100:00100000:0.0:1788651905.424784:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125478144 00000100:00100000:0.0:1788651905.424847:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:0.0:1788651905.424857:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:2388:x1875537125478144:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651905.424872:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651905.424901:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc400/0xcd2f56ea038c3fff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c57 expref: 23 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.424948:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368f00) 00010000:00010000:0.0:1788651905.424953:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651905.425007:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:2388:x1875537125478144:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 151us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651905.425015:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:3.0:1788651905.430030:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651905.433711:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125478272 00000100:00100000:1.0:1788651905.433811:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125478272 00000100:00100000:1.0:1788651905.433892:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:1.0:1788651905.433903:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2391:x1875537125478272:12345-192.168.204.45@tcp:1:lfs.0 00010000:00010000:1.0:1788651905.433980:0:8744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.434001:0:8744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.434010:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651905.434015:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651905.434020:0:8744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.434076:0:8744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 7 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.434090:0:8744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 7 pid: 8427 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651905.434105:0:8744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8744:1875537147593344:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651905.434306:0:8744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ee3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651905.437537:0:8744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8744:1875537147593344:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651905.437567:0:8744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651905.439232:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651905.439546:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125478400 00000100:00100000:1.0:1788651905.439556:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125478400 00002000:00100000:1.0:1788651905.439604:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8f86ff51ca80 x1875537125478400/t0(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:291/0 lens 504/0 e 0 to 0 dl 1788651916 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788651905.439615:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86ff51ca80 with x1875537125478400 ext(0->12) 00010000:00010000:1.0:1788651905.439624:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 8 pid: 8427 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.439639:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 8 pid: 8427 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788651905.439646:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f86ff51ca80 00000100:00100000:1.0:1788651905.439696:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:1.0:1788651905.439707:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2388:x1875537125478400:12345-192.168.204.45@tcp:4:lfs.0 00000001:00100000:2.0:1788651905.448427:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000100:00100000:1.0:1788651905.449446:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2388:x1875537125478400:12345-192.168.204.45@tcp:4:lfs.0 Request processed in 9732us (10216us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788651905.449460:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 0 00002000:00100000:1.0:1788651905.449475:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff8f86ff51ca80 x1875537125478400/t4294967300(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:291/0 lens 504/448 e 0 to 0 dl 1788651916 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788651905.449486:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86ff51ca80 with x1875537125478400 ext(0->12) 00010000:00010000:1.0:1788651905.449496:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 9 pid: 8427 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.449514:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 9 pid: 8427 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788651905.449521:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f86ff51ca80 00000100:00100000:2.0:1788651905.452066:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651905.452160:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125478528 00000100:00100000:3.0:1788651905.452170:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125478528 00010000:00010000:3.0:1788651905.452219:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 9 pid: 8427 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651905.452266:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:3.0:1788651905.452275:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2388:x1875537125478528:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651905.452289:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788651905.452307:0:7919:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788651905.452310:0:7919:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788651904 00002000:00010000:3.0:1788651905.452313:0:7919:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788651905 00002000:00010000:3.0:1788651905.452315:0:7919:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788651904 00002000:00010000:3.0:1788651905.452317:0:7919:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788651905.452323:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 9 pid: 8427 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.452337:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 9 pid: 8427 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.452381:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a06a6982/0xcd2f56ea038c3fd5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c42 expref: 9 pid: 8427 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.452400:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651905.452404:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651905.452410:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.452421:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.452457:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651905.452556:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2388:x1875537125478528:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 281us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651905.452563:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 53 00010000:00010000:1.0:1788651905.452902:0:8744:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.452952:0:8744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.452975:0:8744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.452984:0:8744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.453000:0:8744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.453007:0:8744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651905.453011:0:8744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.453020:0:8744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.453033:0:8744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.453041:0:8744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000863b625e/0xcd2f56ea038c4022 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651905.453101:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2391:x1875537125478272:12345-192.168.204.45@tcp:1:lfs.0 Request processed in 19200us (23263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651905.453108:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:1.0:1788651905.460549:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651905.460800:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125478784 00000100:00100000:2.0:1788651905.460811:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125478784 00000100:00100000:2.0:1788651905.460872:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:2.0:1788651905.460883:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:11158:x1875537125478784:12345-192.168.204.45@tcp:35:lfs.0 00000004:00010000:2.0:1788651905.460988:0:6512:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4014 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c5e expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651905.461497:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788651905.461543:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788651905.461843:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788651905.461878:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.461894:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3fb9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c34 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.461904:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.465376:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c34 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.465397:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c34 expref: 26 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651905.465415:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb10a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6512:1875537147593472:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651905.465618:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c36a3900 going to sleep for 11 seconds 00000100:00100000:1.0:1788651905.485783:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb10a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6512:1875537147593472:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651905.485817:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651905.495111:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651905.495360:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125478912 00000100:00100000:0.0:1788651905.495371:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125478912 00010000:00010000:0.0:1788651905.495412:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c34 expref: 27 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651905.495449:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:0.0:1788651905.495459:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:2388:x1875537125478912:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651905.495475:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651905.495483:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3fb9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c34 expref: 27 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.495497:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3fb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c34 expref: 27 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.495521:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dda00/0xcd2f56ea038c3fb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c34 expref: 27 pid: 6511 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.495541:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368f00) 00010000:00010000:0.0:1788651905.495547:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.495564:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.495572:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.495601:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651905.495663:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+26:2388:x1875537125478912:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 204us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651905.495671:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 54 00010000:00010000:1.0:1788651905.496073:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.496083:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788651905.496197:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:1.0:1788651905.496540:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:1.0:1788651905.496638:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1875537147593600:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788651905.496689:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651905.496727:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c23e1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651905.497198:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147593600 00000100:00100000:2.0:1788651905.497205:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147593600 00000100:00100000:2.0:1788651905.497271:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788651905.497280:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1875537147593600:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:3.0:1788651905.497477:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651905.498078:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6512:x1875537147593600:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 796us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651905.498087:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788651905.498460:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1875537147593600:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788651905.498639:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:1.0:1788651905.498700:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1875537147593728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788651905.498738:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651905.498768:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ee600 going to sleep for 11 seconds 00000100:00100000:0.0:1788651905.499315:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147593728 00000100:00100000:0.0:1788651905.499396:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147593728 00000100:00100000:0.0:1788651905.499451:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788651905.499460:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6512:x1875537147593728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788651905.499595:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6512:x1875537147593728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 135us (855us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788651905.499603:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788651905.500492:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1875537147593728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788651905.500565:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1788651905.500609:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.500619:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.500626:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.500632:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dca00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651905.500636:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.500657:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.500674:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368f00) 00010000:00010000:1.0:1788651905.500677:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788651905.500682:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.500689:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4029 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788651905.500791:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788651905.501886:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788651905.501903:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 361436994775ns, next at 362436991155ns, rc = 0 00000001:00080000:1.0:1788651905.501938:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1788651905.501977:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368f00) 00010000:00010000:1.0:1788651905.501981:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788651905.501989:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4014 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c5e expref: 30 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651905.502118:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:11158:x1875537125478784:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 41236us (41578us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1788651905.502129:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 8 00000020:00080000:1.0:1788651905.502134:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788651905.504489:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788651905.504676:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651905.511308:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147593856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651905.511384:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651905.511620:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147593856 00000100:00100000:0.0:1788651905.511629:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147593856 00000100:00100000:0.0:1788651905.511682:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788651905.511692:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147593856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788651905.511727:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788651905.511775:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147593856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651905.511784:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788651905.511833:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147593856:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788651905.512938:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651905.513149:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125479040 00000100:00100000:0.0:1788651905.513169:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125479040 00000100:00100000:3.0:1788651905.513493:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:3.0:1788651905.513504:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:11158:x1875537125479040:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651905.513526:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651905.513549:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4030 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c65 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.513617:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4030 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c65 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.513632:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4030 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c65 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.513653:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:3.0:1788651905.513656:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651905.513660:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907600, rc 0) 00000100:00100000:3.0:1788651905.513710:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:11158:x1875537125479040:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 209us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651905.513718:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:2.0:1788651905.517479:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651905.517525:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125479296 00000100:00100000:1.0:1788651905.517537:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125479296 00000100:00100000:1.0:1788651905.517600:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:1.0:1788651905.517611:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:11158:x1875537125479296:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:1.0:1788651905.517833:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6ef050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+31:11158:x1875537125479296:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 223us (362us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788651905.517849:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:2.0:1788651905.604839:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651905.604948:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125479552 00000100:00100000:0.0:1788651905.604958:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125479552 00000100:00100000:0.0:1788651905.605014:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00100000:0.0:1788651905.605024:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+31:11168:x1875537125479552:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651905.605048:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651905.605069:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4037 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c6c expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651905.605177:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788651905.605394:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4037 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c6c expref: 33 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.605411:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:0.0:1788651905.605414:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651905.605419:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4037 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c6c expref: 33 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.605435:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96a00, rc 0) 00000100:00100000:0.0:1788651905.605503:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:11168:x1875537125479552:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 480us (674us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788651905.605510:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00100000:3.0:1788651905.611258:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651905.616093:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125479680 00000100:00100000:0.0:1788651905.616108:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125479680 00000100:00100000:0.0:1788651905.616189:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:0.0:1788651905.616199:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:11168:x1875537125479680:12345-192.168.204.45@tcp:34:lfs.0 00010000:00010000:0.0:1788651905.616297:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4045 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616334:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4045 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616347:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4045 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616359:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c404c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616366:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c404c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616373:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c404c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616455:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4053 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616463:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616470:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788651905.616521:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616534:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4045 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616540:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4045 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616556:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4045 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616561:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651905.616565:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4045 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616572:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4045 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616584:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:0.0:1788651905.616587:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651905.616592:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4045 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616598:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4045 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616610:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c404c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616615:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c404c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616619:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c404c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616623:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651905.616625:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c404c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616638:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c404c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616646:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3368500) 00010000:00010000:0.0:1788651905.616648:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651905.616651:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c404c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616656:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c404c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616665:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4053 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616670:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4053 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616675:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4053 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616679:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651905.616681:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4053 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616685:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4053 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616691:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651905.616693:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651905.616696:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4053 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651905.616709:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4053 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651905.616788:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:11168:x1875537125479680:12345-192.168.204.45@tcp:34:lfs.0 Request processed in 590us (5539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651905.616796:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:2.0:1788651905.621641:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651905.621808:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125479936 00000100:00100000:1.0:1788651905.621817:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125479936 00000100:00100000:1.0:1788651905.621969:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:1.0:1788651905.622100:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:11168:x1875537125479936:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:1.0:1788651905.622495:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+33:11168:x1875537125479936:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 398us (864us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1788651905.622503:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:1.0:1788651905.660632:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651905.660753:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125480192 00000100:00100000:0.0:1788651905.660764:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125480192 00000100:00100000:0.0:1788651905.660833:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:0.0:1788651905.660844:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+33:11171:x1875537125480192:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651905.660871:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651905.660894:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c405a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c73 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.661808:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4061 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.661828:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4061 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.661839:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4061 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.661849:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4068 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.661857:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.661863:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662137:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c406f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662147:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c406f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662154:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c406f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651905.662164:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788651905.662316:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4061 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662397:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4061 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662404:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4061 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662410:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651905.662415:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4061 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662423:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4061 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662435:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:1.0:1788651905.662438:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651905.662442:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4061 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662461:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4061 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662475:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4068 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662482:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4068 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662487:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4068 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662492:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651905.662496:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4068 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662502:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4068 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662510:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3368500) 00010000:00010000:1.0:1788651905.662512:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651905.662516:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4068 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662521:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4068 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662564:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c405a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c73 expref: 36 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662581:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c406f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c73 expref: 35 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651905.662594:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:1.0:1788651905.662596:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651905.662599:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414800, rc 0) 00000100:00100000:1.0:1788651905.662795:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:11171:x1875537125480192:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 1952us (2174us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788651905.662803:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:3.0:1788651905.666214:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651905.666443:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125480320 00000100:00100000:2.0:1788651905.666453:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125480320 00000100:00100000:2.0:1788651905.666550:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:2.0:1788651905.666562:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:11171:x1875537125480320:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:2.0:1788651905.666634:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c407d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.666653:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c407d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.666681:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c407d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.666785:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c407d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.666794:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c407d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.666801:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c407d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.666807:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dda00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651905.666812:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c407d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.666820:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c407d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.666832:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651905.666835:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651905.666840:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c407d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651905.666846:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c407d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651905.667038:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:11171:x1875537125480320:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 477us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651905.667046:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:3.0:1788651905.669186:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651905.669597:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125480576 00000100:00100000:1.0:1788651905.669607:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125480576 00000100:00100000:1.0:1788651905.669738:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:1.0:1788651905.669748:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:11171:x1875537125480576:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:1.0:1788651905.669995:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+36:11171:x1875537125480576:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 247us (817us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788651905.670003:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:1.0:1788651905.991686:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651905.991839:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125480832 00000100:00100000:3.0:1788651905.991849:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125480832 00000100:00100000:3.0:1788651905.991952:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:3.0:1788651905.991963:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+36:11202:x1875537125480832:12345-192.168.204.45@tcp:101:cat.0 00010000:00010000:3.0:1788651905.991986:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651905.992005:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4084 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c7a expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.992127:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c408b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.992157:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c408b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.992168:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c408b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651905.992181:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788651905.992471:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4084 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c7a expref: 39 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.992489:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c408b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c7a expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651905.992498:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:3.0:1788651905.992502:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651905.992505:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906200, rc 0) 00000100:00100000:3.0:1788651905.992626:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:11202:x1875537125480832:12345-192.168.204.45@tcp:101:cat.0 Request processed in 665us (949us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788651905.992634:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:0.0:1788651906.000545:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651906.000584:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651906.001131:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125481216 00000100:00100000:1.0:1788651906.001142:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125481216 00000100:00100000:1.0:1788651906.001225:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 12 00000100:00100000:1.0:1788651906.001234:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:11202:x1875537125481216:12345-192.168.204.45@tcp:35:cat.0 00000100:00080000:0.0:1788651906.001414:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651906.001831:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125480960 00000100:00100000:3.0:1788651906.001838:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125480960 00000100:00100000:3.0:1788651906.001873:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:3.0:1788651906.001881:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:2390:x1875537125480960:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651906.001892:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651906.001948:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c408b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c7a expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651906.001988:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:3.0:1788651906.001993:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651906.002107:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:11202:x1875537125481216:12345-192.168.204.45@tcp:35:cat.0 Request processed in 873us (1520us total) trans 4294967334 rc 0/0 00000100:00100000:1.0:1788651906.002115:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 12 00000100:00100000:3.0:1788651906.008943:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:2390:x1875537125480960:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 7050us (8395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651906.008957:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:1.0:1788651906.108289:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651906.108428:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125481472 00000100:00100000:2.0:1788651906.108438:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125481472 00000100:00100000:2.0:1788651906.108499:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:2.0:1788651906.108508:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:11208:x1875537125481472:12345-192.168.204.45@tcp:101:dd.0 00010000:00010000:2.0:1788651906.108532:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651906.108535:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788651906.108562:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c3ff1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c50 expref: 38 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.108579:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651906.108583:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651906.108596:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4099 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c81 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.108718:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.108736:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c406f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c73 expref: 38 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.108745:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.108775:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c406f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c73 expref: 38 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.108788:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c406f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c73 expref: 38 pid: 6509 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651906.108827:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3662680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875537147593984:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651906.109003:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c36a3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788651906.112349:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651906.112452:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3662680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875537147593984:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651906.112483:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651906.112805:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125481600 00000100:00100000:0.0:1788651906.112814:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125481600 00010000:00010000:0.0:1788651906.112853:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c406f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c73 expref: 39 pid: 6509 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651906.112892:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00100000:0.0:1788651906.112948:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:2388:x1875537125481600:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651906.112963:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651906.112969:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c406f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c73 expref: 39 pid: 6509 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.112989:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c406f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c73 expref: 39 pid: 6509 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.113021:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c406f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c73 expref: 39 pid: 6509 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.113039:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651906.113044:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.113054:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.113062:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.113081:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651906.113137:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:2388:x1875537125481600:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 190us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651906.113145:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 55 00010000:00010000:1.0:1788651906.113233:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651906.113241:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651906.113261:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788651906.113420:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4099 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c81 expref: 39 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651906.113437:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c81 expref: 38 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651906.113444:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:1.0:1788651906.113447:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788651906.113449:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd400, rc 0) 00000100:00100000:1.0:1788651906.113475:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:11208:x1875537125481472:12345-192.168.204.45@tcp:101:dd.0 Request processed in 4968us (5197us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788651906.113482:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:3.0:1788651906.118116:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651906.118250:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125481728 00000100:00100000:2.0:1788651906.118260:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125481728 00000100:00100000:2.0:1788651906.118316:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 61 00000100:00100000:2.0:1788651906.118325:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:11208:x1875537125481728:12345-192.168.204.45@tcp:101:dd.0 00010000:00010000:2.0:1788651906.118349:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651906.118371:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c40ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c88 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.118405:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c40b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.118420:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c40b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.118431:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c40b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.118557:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c40ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c88 expref: 40 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.118575:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c40b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c88 expref: 39 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.118583:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651906.118593:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788651906.118597:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc800, rc 0) 00000100:00100000:2.0:1788651906.118657:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:11208:x1875537125481728:12345-192.168.204.45@tcp:101:dd.0 Request processed in 333us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651906.118663:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 61 00000100:00100000:2.0:1788651906.123043:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651906.123495:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125481984 00000100:00100000:0.0:1788651906.123506:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125481984 00000100:00100000:0.0:1788651906.123572:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 62 00000100:00100000:0.0:1788651906.123583:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:11208:x1875537125481984:12345-192.168.204.45@tcp:36:dd.0 00010000:00010000:0.0:1788651906.123878:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.123939:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.123968:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651906.124113:0:10110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:0.0:1788651906.124140:0:10110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000705a62ec reply state 00000000053992bb transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.124154:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.124161:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651906.124164:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788651906.124167:0:10110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788651906.124326:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+42:11208:x1875537125481984:12345-192.168.204.45@tcp:36:dd.0 Request processed in 745us (1315us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788651906.124334:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 62 00000020:00080000:0.0:1788651906.124338:0:10110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788651906.504770:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651906.504937:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125482112 00000100:00100000:2.0:1788651906.504947:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125482112 00000100:00100000:2.0:1788651906.505007:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 63 00000100:00100000:2.0:1788651906.505023:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+42:11222:x1875537125482112:12345-192.168.204.45@tcp:101:stat.0 00010000:00010000:2.0:1788651906.505048:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651906.505069:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c40c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c8f expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.505135:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c40ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.505149:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c40ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.505160:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c40ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.505192:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c40d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.505339:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c40d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.505349:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c40d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.505431:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.505442:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c81 expref: 43 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.505451:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.505485:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c81 expref: 43 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.505499:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c81 expref: 43 pid: 6509 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651906.505513:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875537147594112:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651906.505615:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c36a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788651906.514784:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651906.516131:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125482368 00000100:00100000:1.0:1788651906.516147:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125482368 00000100:00100000:1.0:1788651906.516234:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:1.0:1788651906.516245:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+44:6164:x1875537125482368:12345-192.168.204.45@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788651906.516564:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+45:6164:x1875537125482368:12345-192.168.204.45@tcp:35:ldlm_bl.0 Request processed in 320us (1790us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788651906.516572:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:2.0:1788651906.517139:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875537147594112:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651906.517166:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651906.521322:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651906.521463:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125482496 00000100:00100000:0.0:1788651906.521473:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125482496 00010000:00010000:0.0:1788651906.521512:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c81 expref: 45 pid: 6509 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651906.521554:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:0.0:1788651906.521565:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2833800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+45:2389:x1875537125482496:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651906.521580:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651906.521586:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c81 expref: 45 pid: 6509 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.521619:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c81 expref: 45 pid: 6509 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.521642:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c40a0 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c81 expref: 45 pid: 6509 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.521661:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651906.521667:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.521676:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.521684:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.521728:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651906.521845:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2833800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+44:2389:x1875537125482496:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 281us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651906.521852:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 56 00010000:00010000:2.0:1788651906.522023:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522031:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651906.522083:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788651906.522094:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651906.522137:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522151:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522162:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c40ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522168:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c40ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522174:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c40ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522180:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651906.522184:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c40ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522191:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c40ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522214:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651906.522217:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651906.522221:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c40ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522227:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c40ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522239:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c40d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522255:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c40d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522261:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c40d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522266:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651906.522269:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c40d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522275:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c40d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522282:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3368500) 00010000:00010000:2.0:1788651906.522285:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651906.522287:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c40d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522293:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c40d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522325:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c40c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c8f expref: 44 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522339:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c8f expref: 43 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.522345:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651906.522347:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651906.522355:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dda00, rc 0) 00000100:00100000:2.0:1788651906.522384:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+43:11222:x1875537125482112:12345-192.168.204.45@tcp:101:stat.0 Request processed in 17363us (17626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651906.522391:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 63 00010000:00010000:0.0:1788651906.528435:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651906.665814:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651906.665973:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125482752 00000100:00100000:3.0:1788651906.665984:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125482752 00000100:00100000:3.0:1788651906.666045:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 64 00000100:00100000:3.0:1788651906.666056:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+43:11228:x1875537125482752:12345-192.168.204.45@tcp:36:truncate.0 00010000:00010000:3.0:1788651906.666143:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651906.666173:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c40d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c8f expref: 43 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651906.666191:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:3.0:1788651906.666196:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651906.666364:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651906.666378:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651906.666388:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651906.666427:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:3.0:1788651906.666448:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007ee87570 reply state 00000000b0bcd5b3 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651906.666468:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651906.666475:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:3.0:1788651906.666477:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788651906.666480:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651906.666592:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+45:11228:x1875537125482752:12345-192.168.204.45@tcp:36:truncate.0 Request processed in 536us (786us total) trans 4294967340 rc 0/0 00000100:00100000:3.0:1788651906.666600:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 64 00000020:00080000:3.0:1788651906.666605:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788651906.854836:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651906.854941:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125482880 00000100:00100000:0.0:1788651906.854961:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125482880 00000100:00100000:0.0:1788651906.855073:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 65 00000100:00100000:0.0:1788651906.855085:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+45:11242:x1875537125482880:12345-192.168.204.45@tcp:101:stat.0 00010000:00010000:0.0:1788651906.855109:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651906.855305:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c40e6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c96 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855373:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c40ed lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855388:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c40ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855399:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c40ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855408:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c40f4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855415:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c40f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855421:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c40f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855485:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855494:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855501:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651906.855541:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788651906.855544:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788651906.855567:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855586:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855595:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c40ed lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855601:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c40ed lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855608:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c40ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855615:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651906.855619:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c40ed lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855627:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c40ed lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855639:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:0.0:1788651906.855642:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651906.855646:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c40ed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855652:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c40ed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855666:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c40f4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855672:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c40f4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855685:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c40f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855690:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651906.855693:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c40f4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855699:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c40f4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855707:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3368500) 00010000:00010000:0.0:1788651906.855709:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651906.855712:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c40f4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855718:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c40f4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855746:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c40e6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c96 expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855760:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c96 expref: 46 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651906.855767:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651906.855769:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651906.855772:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97400, rc 0) 00000100:00100000:0.0:1788651906.856005:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+46:11242:x1875537125482880:12345-192.168.204.45@tcp:101:stat.0 Request processed in 827us (1082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651906.856034:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 65 00000100:00100000:1.0:1788651906.991546:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651906.991647:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125483136 00000100:00100000:2.0:1788651906.991658:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125483136 00000100:00100000:2.0:1788651906.991726:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 66 00000100:00100000:2.0:1788651906.991735:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+46:11252:x1875537125483136:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651906.991756:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651906.991777:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4102 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33c9d expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651906.991901:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788651906.992026:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4102 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c9d expref: 48 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.992041:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:2.0:1788651906.992043:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651906.992048:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4102 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c9d expref: 48 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651906.992060:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dde00, rc 0) 00000100:00100000:2.0:1788651906.992236:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2832680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+47:11252:x1875537125483136:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 501us (701us total) trans 4294967341 rc 301/301 00000100:00100000:2.0:1788651906.992243:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 66 00000100:00100000:1.0:1788651907.004677:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651907.004777:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125483392 00000100:00100000:2.0:1788651907.004787:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125483392 00000100:00100000:2.0:1788651907.005025:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:2.0:1788651907.005052:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+47:11252:x1875537125483392:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:2.0:1788651907.005456:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+48:11252:x1875537125483392:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 406us (786us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1788651907.005465:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:3.0:1788651907.040468:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147594240:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651907.040562:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651907.040671:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147594240 00000100:00100000:2.0:1788651907.040680:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147594240 00000100:00100000:2.0:1788651907.040738:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788651907.040748:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147594240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788651907.040781:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446301696 avail 1300062208 00000100:00100000:2.0:1788651907.044595:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147594240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3836us (4021us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651907.044609:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788651907.045364:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147594240:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788651907.116283:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.116391:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125483648 00000100:00100000:0.0:1788651907.116403:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125483648 00000100:00100000:0.0:1788651907.116478:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00100000:0.0:1788651907.116492:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+48:11258:x1875537125483648:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788651907.116520:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651907.116541:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4110 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ca4 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.116675:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.116693:0:10110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c96 expref: 49 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.116703:0:10110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.116738:0:10110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c96 expref: 49 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.116752:0:10110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c96 expref: 49 pid: 6510 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651907.116766:0:10110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147594368:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651907.118671:0:10110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651907.124487:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651907.124606:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125483776 00000100:00100000:2.0:1788651907.124617:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125483776 00010000:00010000:2.0:1788651907.124662:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c96 expref: 50 pid: 6510 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651907.124706:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:2.0:1788651907.124715:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+50:2389:x1875537125483776:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651907.124729:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651907.124736:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c96 expref: 50 pid: 6510 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.124750:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c96 expref: 50 pid: 6510 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.124794:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651907.124800:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.125032:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.125041:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.125064:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651907.125268:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+50:2389:x1875537125483776:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 553us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651907.125277:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 57 00010000:00010000:0.0:1788651907.127663:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c40fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c96 expref: 49 pid: 6510 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651907.127698:0:10110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147594368:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651907.127721:0:10110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.127730:0:10110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.127735:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651907.127756:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788651907.129946:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4110 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ca4 expref: 50 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.129991:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ca4 expref: 49 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.130002:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651907.130005:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788651907.130009:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97800, rc 0) 00000100:00100000:0.0:1788651907.130247:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+49:11258:x1875537125483648:12345-192.168.204.45@tcp:101:bash.0 Request processed in 13757us (13974us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788651907.130258:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00100000:1.0:1788651907.134430:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.134698:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125484032 00000100:00100000:0.0:1788651907.134709:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125484032 00000100:00100000:0.0:1788651907.134772:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 68 00000100:00100000:0.0:1788651907.134959:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+49:11258:x1875537125484032:12345-192.168.204.45@tcp:36:bash.0 00010000:00010000:0.0:1788651907.135800:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.135820:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.135833:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651907.136619:0:6510:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:0.0:1788651907.136661:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000032031e8c reply state 0000000047deaf69 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.136676:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.137122:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651907.137127:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788651907.137131:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788651907.137656:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+52:11258:x1875537125484032:12345-192.168.204.45@tcp:36:bash.0 Request processed in 2852us (3234us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1788651907.137665:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 68 00000020:00080000:0.0:1788651907.137671:0:6510:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788651907.151641:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651907.151799:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125484160 00000100:00100000:3.0:1788651907.151818:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125484160 00000100:00100000:3.0:1788651907.152002:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:3.0:1788651907.152014:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+52:11258:x1875537125484160:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:3.0:1788651907.152038:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651907.152059:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c412c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cab expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651907.152153:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4133 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651907.152169:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ca4 expref: 53 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651907.152177:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4133 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651907.152247:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ca4 expref: 53 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651907.152261:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ca4 expref: 53 pid: 10110 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651907.152277:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c3391c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147594496:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651907.152366:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952600 going to sleep for 11 seconds 00000100:00100000:3.0:1788651907.158582:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c3391c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147594496:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651907.158616:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4133 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651907.164030:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.164126:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125484288 00000100:00100000:0.0:1788651907.164138:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125484288 00010000:00010000:0.0:1788651907.164180:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ca4 expref: 54 pid: 10110 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651907.164228:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:0.0:1788651907.164239:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+54:2388:x1875537125484288:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651907.164270:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651907.164279:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ca4 expref: 54 pid: 10110 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.164293:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ca4 expref: 54 pid: 10110 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.164328:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4117 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ca4 expref: 54 pid: 10110 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.164348:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651907.164354:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4133 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.164366:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4133 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.164375:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4133 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.164410:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651907.164469:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2832a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+53:2388:x1875537125484288:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 232us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651907.164476:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 58 00010000:00010000:1.0:1788651907.165810:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4133 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651907.165834:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4133 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651907.165933:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788651907.165947:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788651907.165975:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4133 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651907.166114:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c412c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cab expref: 53 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651907.166137:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4133 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cab expref: 52 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651907.166145:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:1.0:1788651907.166148:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651907.166151:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906c00, rc 0) 00000100:00100000:1.0:1788651907.166216:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2832300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+52:11258:x1875537125484160:12345-192.168.204.45@tcp:101:bash.0 Request processed in 14203us (14585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651907.166302:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:1.0:1788651907.169356:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651907.169416:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125484544 00000100:00100000:3.0:1788651907.169427:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125484544 00000100:00100000:3.0:1788651907.169485:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:3.0:1788651907.169495:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+52:11258:x1875537125484544:12345-192.168.204.45@tcp:35:bash.0 00000100:00100000:3.0:1788651907.169725:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6ecc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+53:11258:x1875537125484544:12345-192.168.204.45@tcp:35:bash.0 Request processed in 231us (378us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788651907.169733:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:0.0:1788651907.238507:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.238558:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.238593:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.238620:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.238644:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.238686:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125485184 00000100:00100000:0.0:1788651907.238695:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125485184 00000100:00100000:0.0:1788651907.238749:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125484800 00000100:00100000:0.0:1788651907.238752:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125484800 00000100:00100000:0.0:1788651907.238770:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125485056 00000100:00100000:0.0:1788651907.238773:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125485056 00000100:00100000:0.0:1788651907.238793:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 290 00000100:00100000:0.0:1788651907.238802:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125485184:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651907.238889:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125485184:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 88us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651907.238898:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 290 00000100:00100000:0.0:1788651907.238949:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 291 00000100:00100000:0.0:1788651907.238957:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125484800:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651907.238984:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125484800:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651907.238992:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 291 00000100:00100000:0.0:1788651907.239003:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 292 00000100:00100000:0.0:1788651907.239010:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125485056:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651907.239034:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125485056:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651907.239039:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 292 00000100:00080000:0.0:1788651907.239055:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651907.239059:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788651907.239439:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125484928 00000100:00100000:2.0:1788651907.239445:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125484928 00000100:00100000:2.0:1788651907.239492:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 109 00000100:00100000:2.0:1788651907.239500:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125484928:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651907.239529:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125484928:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 31us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651907.239535:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 109 00000100:00100000:1.0:1788651907.241073:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125484672 00000100:00100000:1.0:1788651907.241084:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125484672 00000100:00100000:1.0:1788651907.241153:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 384 00000100:00100000:1.0:1788651907.241163:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125484672:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651907.241230:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125484672:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 69us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651907.241237:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 384 00000100:00080000:0.0:1788651907.243029:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651907.278095:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.278526:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125485440 00000100:00100000:0.0:1788651907.278537:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125485440 00000100:00100000:0.0:1788651907.278657:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 70 00000100:00100000:0.0:1788651907.278744:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+53:11268:x1875537125485440:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651907.278769:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651907.278792:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c413a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cb2 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651907.279471:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788651907.279574:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c413a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cb2 expref: 55 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.279589:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:0.0:1788651907.279592:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651907.279598:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c413a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cb2 expref: 55 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.279613:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97800, rc 0) 00000100:00100000:0.0:1788651907.279801:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2832d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+54:11268:x1875537125485440:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 1122us (1714us total) trans 4294967347 rc 301/301 00000100:00100000:0.0:1788651907.279809:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 70 00000100:00100000:1.0:1788651907.283857:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651907.284335:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125485568 00000100:00100000:2.0:1788651907.284346:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125485568 00000100:00100000:2.0:1788651907.284435:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 71 00000100:00100000:2.0:1788651907.284446:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+54:11268:x1875537125485568:12345-192.168.204.45@tcp:34:lfs.0 00010000:00010000:2.0:1788651907.284520:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4148 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284549:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4148 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284562:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4148 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284574:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c414f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284581:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c414f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284587:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c414f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284657:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4156 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284665:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284672:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651907.284793:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284806:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4148 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284812:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4148 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284830:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4148 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284836:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651907.284841:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4148 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284849:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4148 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284882:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651907.284885:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651907.284891:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4148 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284898:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4148 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284933:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c414f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284940:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c414f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284945:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c414f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284950:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651907.284952:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c414f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284968:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c414f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284976:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3368500) 00010000:00010000:2.0:1788651907.284978:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651907.284981:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c414f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284987:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c414f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.284996:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4156 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.285001:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4156 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.285007:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4156 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.285080:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651907.285084:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4156 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.285091:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4156 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.285098:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651907.285100:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651907.285104:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4156 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.285119:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4156 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651907.285302:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+54:11268:x1875537125485568:12345-192.168.204.45@tcp:34:lfs.0 Request processed in 856us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651907.285311:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 71 00000100:00100000:1.0:1788651907.290382:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651907.290477:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125485824 00000100:00100000:3.0:1788651907.290487:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125485824 00000100:00100000:3.0:1788651907.290560:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:3.0:1788651907.290570:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+54:11268:x1875537125485824:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:3.0:1788651907.290810:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+55:11268:x1875537125485824:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 240us (436us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788651907.290832:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:1.0:1788651907.332123:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651907.332232:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125486080 00000100:00100000:2.0:1788651907.332242:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125486080 00000100:00100000:2.0:1788651907.332309:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 72 00000100:00100000:2.0:1788651907.332320:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+55:11271:x1875537125486080:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651907.332343:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651907.332364:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c415d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cb9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332435:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4164 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332449:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4164 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332460:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4164 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332470:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c416b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332476:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c416b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332499:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c416b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332602:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4172 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332611:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332619:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4172 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651907.332628:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788651907.332713:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4164 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332721:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4164 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332726:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4164 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332732:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651907.332736:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4164 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332742:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4164 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332753:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651907.332755:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651907.332766:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4164 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332772:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4164 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332786:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c416b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332792:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c416b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332797:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c416b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332801:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651907.332804:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c416b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332809:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c416b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332816:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3368500) 00010000:00010000:2.0:1788651907.332818:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651907.332821:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c416b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332826:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c416b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332859:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c415d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cb9 expref: 58 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332898:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4172 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cb9 expref: 57 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.332904:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651907.333422:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651907.333426:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dca00, rc 0) 00000100:00100000:2.0:1788651907.333553:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+57:11271:x1875537125486080:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 1234us (1438us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788651907.333561:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 72 00000001:00080000:0.0:1788651907.336073:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000004:00080000:0.0:1788651907.336120:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:0.0:1788651907.336141:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f85c23e1540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1788651907.336147:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86d14bcc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f85c23e1c00 00000020:00080000:0.0:1788651907.336149:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f85c20aa600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f86fcd16200 00010000:00010000:2.0:1788651907.336235:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336247:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336254:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336261:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dc200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651907.336266:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336273:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336288:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8f85c3368000) 00010000:00010000:2.0:1788651907.336291:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651907.336295:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336313:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dc200/0xcd2f56ea038c3f6c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336336:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336341:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336346:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336351:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dce00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651907.336354:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336360:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336367:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651907.336370:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651907.336372:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336378:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dce00/0xcd2f56ea038c3f73 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336391:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336397:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336411:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336415:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c29dca00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651907.336418:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336424:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336431:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3368500) 00010000:00010000:2.0:1788651907.336433:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651907.336435:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336440:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dca00/0xcd2f56ea038c3fb2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336454:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336460:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336465:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336470:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651907.336472:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336487:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336495:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651907.336498:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651907.336500:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336506:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c40bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336518:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336524:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336530:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336535:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651907.336538:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336544:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336552:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651907.336555:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651907.336557:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336573:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c40df lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336584:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336591:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336597:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336602:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651907.336605:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336610:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336618:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651907.336620:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651907.336623:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.336627:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4125 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788651907.336817:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788651907.337031:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788651907.337268:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147594624:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788651907.337336:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651907.337850:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147594624 00000100:00100000:0.0:1788651907.337859:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147594624 00000100:00100000:0.0:1788651907.337952:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788651907.337963:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3635:x1875537147594624:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788651907.337999:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:0.0:1788651907.338331:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ca980, atime: 0x6a9ca981, ctime: 0x6a9ca980, blocks: 0x8 00010000:00010000:0.0:1788651907.338340:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009049f5bc/0xcd2f56ea038c4180 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.338355:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1788651907.338360:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651907.338366:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009049f5bc/0xcd2f56ea038c4180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.338382:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009049f5bc/0xcd2f56ea038c4180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.338392:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009049f5bc/0xcd2f56ea038c4180 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.338399:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009049f5bc/0xcd2f56ea038c4180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.338426:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788651907.338590:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3635:x1875537147594624:12345-0@lo:6:osp-syn-0-0.0 Request processed in 628us (1252us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788651907.338598:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788651907.338667:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651907.338695:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009049f5bc/0xcd2f56ea038c4180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.338703:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788651907.338707:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009049f5bc/0xcd2f56ea038c4180 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.338715:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009049f5bc/0xcd2f56ea038c4180 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.338735:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009049f5bc/0xcd2f56ea038c4180 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.338742:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009049f5bc/0xcd2f56ea038c4180 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.338763:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651907.338765:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651907.338767:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788651907.338932:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f85c2831f80/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788651907.338940:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2831f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147594624:0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1788651907.339001:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651907.341748:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.342005:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125486208 00000100:00100000:0.0:1788651907.342016:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125486208 00000100:00100000:0.0:1788651907.342080:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 73 00000100:00100000:0.0:1788651907.342090:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:11271:x1875537125486208:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:0.0:1788651907.342171:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4187 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.342289:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4187 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.342303:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4187 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.342342:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4187 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.342349:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4187 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.342355:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4187 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.342360:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651907.342364:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4187 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.342372:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4187 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.342382:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651907.342386:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651907.342391:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4187 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.342397:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4187 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651907.342484:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:11271:x1875537125486208:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 394us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651907.342492:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 73 00000100:00100000:1.0:1788651907.345718:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651907.346129:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651907.346203:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125486592 00000100:00100000:2.0:1788651907.346215:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125486592 00000100:00100000:2.0:1788651907.346273:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:2.0:1788651907.346284:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:11271:x1875537125486592:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:2.0:1788651907.346499:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:11271:x1875537125486592:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 216us (370us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788651907.346506:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:3.0:1788651907.347051:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125486336 00000100:00100000:3.0:1788651907.347058:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125486336 00000100:00100000:3.0:1788651907.347109:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:3.0:1788651907.347117:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:2390:x1875537125486336:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651907.347129:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651907.347152:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4172 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cb9 expref: 14 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651907.347169:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:3.0:1788651907.347174:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651907.347214:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:2390:x1875537125486336:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 98us (1504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651907.347220:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:1.0:1788651907.489246:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651907.489338:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125486848 00000100:00100000:2.0:1788651907.489359:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125486848 00000100:00100000:2.0:1788651907.489414:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 74 00000100:00100000:2.0:1788651907.489424:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:11289:x1875537125486848:12345-192.168.204.45@tcp:101:cat.0 00010000:00010000:2.0:1788651907.489445:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651907.489463:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c418e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cc0 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.489562:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4195 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.489577:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4195 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.489589:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4195 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651907.489599:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788651907.489703:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c418e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cc0 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.489722:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4195 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cc0 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.489731:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651907.489734:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788651907.489737:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd200, rc 0) 00000100:00100000:2.0:1788651907.489790:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11289:x1875537125486848:12345-192.168.204.45@tcp:101:cat.0 Request processed in 368us (555us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788651907.489797:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 74 00000100:00100000:0.0:1788651907.516534:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651907.516642:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125486976 00000100:00100000:2.0:1788651907.516652:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125486976 00000100:00100000:2.0:1788651907.516731:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 75 00000100:00100000:2.0:1788651907.516742:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11290:x1875537125486976:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651907.516766:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651907.516788:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cc7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.516854:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c41aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.516879:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c41aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.516891:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c41aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651907.516958:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788651907.516963:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651907.516982:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c41aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.517011:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cc7 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.517048:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c41aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cc7 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.517056:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651907.517059:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651907.517075:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc000, rc 0) 00000100:00100000:2.0:1788651907.517143:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11290:x1875537125486976:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 404us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651907.517150:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 75 00000100:00100000:1.0:1788651907.521234:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651907.521483:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125487360 00000100:00100000:2.0:1788651907.521493:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125487360 00000100:00100000:2.0:1788651907.521548:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:2.0:1788651907.521558:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11290:x1875537125487360:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:2.0:1788651907.522061:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:11290:x1875537125487360:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 503us (834us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788651907.522069:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:1.0:1788651907.524285:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.524422:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125487488 00000100:00100000:0.0:1788651907.524431:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125487488 00000100:00100000:0.0:1788651907.524495:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:0.0:1788651907.524505:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:11290:x1875537125487488:12345-192.168.204.45@tcp:103:lfs.0 00010000:00010000:0.0:1788651907.524522:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788651907.524546:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4133 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cab expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.524569:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4195 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cc0 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.524582:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4030 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c65 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.524592:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651907.524597:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651907.524654:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:11290:x1875537125487488:12345-192.168.204.45@tcp:103:lfs.0 Request processed in 150us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651907.524660:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:0.0:1788651907.526574:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651907.527077:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125487616 00000100:00100000:2.0:1788651907.527087:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125487616 00000100:00100000:2.0:1788651907.527148:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 76 00000100:00100000:2.0:1788651907.527159:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:11290:x1875537125487616:12345-192.168.204.45@tcp:58:lfs.0 00010000:00010000:2.0:1788651907.527432:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41b1 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.527451:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651907.527462:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788651907.527781:0:10110:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788651907.528122:0:10110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788651907.528514:0:10110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788651907.528665:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:11290:x1875537125487616:12345-192.168.204.45@tcp:58:lfs.0 Request processed in 1506us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651907.528693:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 76 00000100:00100000:1.0:1788651907.550071:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651907.550273:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125487744 00000100:00100000:0.0:1788651907.550284:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125487744 00000100:00100000:0.0:1788651907.550374:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 77 00000100:00100000:0.0:1788651907.550384:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:11292:x1875537125487744:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651907.550407:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651907.550430:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c41b8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cce expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550519:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41bf lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550536:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550549:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550565:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c41c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550571:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c41c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550577:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c41c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550649:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550658:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550664:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651907.550716:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788651907.550720:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788651907.550737:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550748:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550755:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41bf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550761:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41bf lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550768:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550774:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651907.550778:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41bf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550784:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41bf lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550796:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:0.0:1788651907.550799:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651907.550804:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550811:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550835:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c41c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550841:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c41c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550846:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c41c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550851:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651907.550854:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c41c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550860:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c41c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550877:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3352e00) 00010000:00010000:0.0:1788651907.550880:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651907.550883:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c41c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550889:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c41c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550985:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c41b8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cce expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.550998:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cce expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651907.551018:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651907.551020:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651907.551024:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97600, rc 0) 00000100:00100000:0.0:1788651907.552216:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11292:x1875537125487744:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 1821us (2143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651907.552226:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 77 00010000:00010000:2.0:1788651907.552443:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788651908.129141:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788651908.129150:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788651908.129187:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788651908.129195:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788651908.129399:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147594752:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788651908.130408:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2988e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651908.141230:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651908.141782:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125487872 00000100:00100000:0.0:1788651908.141792:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125487872 00000100:00100000:0.0:1788651908.141875:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 78 00000100:00100000:0.0:1788651908.141887:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11304:x1875537125487872:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000100:00100000:3.0:1788651908.141920:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147594752:192.168.204.45@tcp:107:hsm_cdtr.0 00000004:00000080:0.0:1788651908.142008:0:12192:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788651908.142122:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11304:x1875537125487872:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 238us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.142131:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 78 00000100:00080000:2.0:1788651908.142194:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651908.149642:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.149741:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125488000 00000100:00100000:2.0:1788651908.149750:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125488000 00000100:00100000:2.0:1788651908.149810:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 79 00000100:00100000:2.0:1788651908.149819:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11304:x1875537125488000:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788651908.149901:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c41d4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.149951:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c41d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.149967:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c41d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150035:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c41db lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150044:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c41db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150052:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c41db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150081:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41e2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150090:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150118:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651908.150170:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788651908.150187:0:10110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651908.150200:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150212:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c41d4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150219:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c41d4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150226:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c41d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150232:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651908.150236:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c41d4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150244:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c41d4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150256:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:2.0:1788651908.150259:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651908.150264:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c41d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150271:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c41d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150294:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c41db lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150300:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c41db lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150307:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c41db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150312:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651908.150315:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c41db lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150321:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c41db lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150330:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff8f86c3a44300) 00010000:00010000:2.0:1788651908.150332:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651908.150335:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c41db lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150340:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c41db lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150354:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150372:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41e2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150378:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150391:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651908.150394:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41e2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150400:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41e2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150408:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651908.150410:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651908.150413:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41e2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.150418:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41e2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.150493:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3391c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11304:x1875537125488000:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 Request processed in 673us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651908.150503:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 79 00000100:00100000:3.0:1788651908.155404:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651908.155760:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125488256 00000100:00100000:0.0:1788651908.155770:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125488256 00000100:00100000:0.0:1788651908.155838:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 80 00000100:00100000:0.0:1788651908.155848:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11304:x1875537125488256:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651908.155902:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651908.156072:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c41e9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cd5 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156258:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156275:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156288:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651908.156300:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788651908.156373:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156380:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156387:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156392:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651908.156398:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156405:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156417:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651908.156427:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651908.156433:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156440:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c41f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156482:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c41e9 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cd5 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156494:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:0.0:1788651908.156497:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651908.156502:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c41e9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cd5 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.156513:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96600, rc 0) 00000100:00100000:0.0:1788651908.156579:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3390700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11304:x1875537125488256:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 732us (1184us total) trans 4294967353 rc 301/301 00000100:00100000:0.0:1788651908.156587:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 80 00000100:00100000:1.0:1788651908.166012:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651908.166173:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125488384 00000100:00100000:0.0:1788651908.166185:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125488384 00000100:00100000:0.0:1788651908.166240:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 81 00000100:00100000:0.0:1788651908.166250:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11304:x1875537125488384:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788651908.166287:0:6509:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788651908.166412:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11304:x1875537125488384:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 163us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.166419:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 81 00000100:00100000:3.0:1788651908.171839:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.171959:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125488640 00000100:00100000:2.0:1788651908.171970:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125488640 00000100:00100000:2.0:1788651908.172035:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 82 00000100:00100000:2.0:1788651908.172045:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11304:x1875537125488640:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651908.172067:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651908.172070:0:10110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788651908.172097:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c41aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cc7 expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.172116:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651908.172133:0:10110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651908.172146:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41fe lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cdc expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788651908.172520:0:10110:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788651908.172655:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c4205 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.172668:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c4205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.172678:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c4205 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.172721:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c41fe lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cdc expref: 18 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.172735:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c4205 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cdc expref: 17 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.172743:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44300) 00010000:00010000:2.0:1788651908.172746:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651908.172749:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd600, rc 0) 00000100:00100000:2.0:1788651908.172811:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3390a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:11304:x1875537125488640:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 767us (982us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788651908.172817:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 82 00000100:00100000:3.0:1788651908.176111:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651908.176173:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125488896 00000100:00100000:0.0:1788651908.176197:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125488896 00000100:00100000:0.0:1788651908.176261:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 83 00000100:00100000:0.0:1788651908.176273:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:11304:x1875537125488896:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788651908.176329:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651908.176354:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c4205 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cdc expref: 17 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176371:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44300) 00010000:00010000:0.0:1788651908.176381:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651908.176403:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4213 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176415:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4213 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176424:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4213 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176498:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c421a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x443056e9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176506:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c421a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x443056e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176512:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c421a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x443056e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176553:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4213 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176560:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4213 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176574:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4213 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176579:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651908.176584:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4213 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176591:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4213 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176600:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:0.0:1788651908.176603:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651908.176607:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4213 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176613:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4213 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176624:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c421a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x443056e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176629:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c421a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x443056e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176634:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c421a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x443056e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176638:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651908.176641:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c421a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x443056e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176656:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c421a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x443056e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176664:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x443056e9 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651908.176666:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651908.176669:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c421a lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x443056e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.176675:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c421a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x443056e9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651908.176758:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3391180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11304:x1875537125488896:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 487us (656us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788651908.176766:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 83 00000100:00100000:1.0:1788651908.182009:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.182278:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125489024 00000100:00100000:2.0:1788651908.182289:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125489024 00000100:00100000:2.0:1788651908.182350:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 84 00000100:00100000:2.0:1788651908.182373:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11304:x1875537125489024:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651908.182410:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651908.182432:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4221 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ce3 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.182466:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4228 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.182480:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.182491:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4228 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.182598:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4221 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ce3 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.182615:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4228 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ce3 expref: 17 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.182624:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:2.0:1788651908.182627:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788651908.182630:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc000, rc 0) 00000100:00100000:2.0:1788651908.182696:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:11304:x1875537125489024:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 337us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651908.182702:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 84 00000100:00100000:3.0:1788651908.188845:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.188954:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125489280 00000100:00100000:2.0:1788651908.188965:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125489280 00000100:00100000:2.0:1788651908.189018:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 85 00000100:00100000:2.0:1788651908.189027:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:11304:x1875537125489280:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788651908.189128:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.189146:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.189160:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788651908.189346:0:10110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788651908.189371:0:10110:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 364124461969ns, next at 365124447452ns, rc = 0 00000004:00010000:2.0:1788651908.189428:0:10110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005091f150 reply state 00000000d6c86475 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.189441:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.189451:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:2.0:1788651908.189454:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788651908.189459:0:10110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651908.189565:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3392300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:11304:x1875537125489280:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 538us (727us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788651908.189574:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 85 00000100:00100000:3.0:1788651908.199791:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.199920:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125489408 00000100:00100000:2.0:1788651908.199933:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125489408 00000100:00100000:2.0:1788651908.199992:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 86 00000100:00100000:2.0:1788651908.200003:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:11304:x1875537125489408:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651908.200030:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651908.200052:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c4236 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cea expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.200117:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c4236 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cea expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.200132:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c4236 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cea expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.200150:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:2.0:1788651908.200153:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651908.200156:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd800, rc 0) 00000100:00100000:2.0:1788651908.200228:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3393480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:11304:x1875537125489408:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 227us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651908.200242:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 86 00000100:00100000:2.0:1788651908.205371:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651908.205569:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125489536 00000100:00100000:3.0:1788651908.205581:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125489536 00000100:00100000:3.0:1788651908.205629:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:3.0:1788651908.205639:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1875537125489536:12345-192.168.204.45@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788651908.205680:0:8428:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp t0 exp 0000000000000000 cur 364 last 0 00000020:00000080:3.0:1788651908.205721:0:8428:0:(genops.c:1385:class_connect()) connect: client 72121fb7-fb91-4477-92d5-4e7fe3e6b65d, cookie 0xcd2f56ea038c423d 00002000:00100000:3.0:1788651908.205734:0:8428:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 72121fb7-fb91-4477-92d5-4e7fe3e6b65d/ffff8f86c4e7a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788651908.205756:0:8428:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788651908.205842:0:8428:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788651908.205891:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8f86c4e7b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788651908.206171:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2387:x1875537125489536:12345-192.168.204.45@tcp:8:lhsmtool_posix.0 Request processed in 531us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651908.206180:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:3.0:1788651908.216285:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651908.216360:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125489664 00000100:00100000:0.0:1788651908.216370:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125489664 00000100:00100000:0.0:1788651908.216441:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:0.0:1788651908.216452:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:0:x1875537125489664:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788651908.216777:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788651908.218347:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:0.0:1788651908.218358:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000100:00100000:3.0:1788651908.218525:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3390000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:0:x1875537125489664:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 2071us (2245us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788651908.218536:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:2.0:1788651908.222288:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651908.222520:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125489920 00000100:00100000:3.0:1788651908.222529:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125489920 00000100:00100000:3.0:1788651908.222588:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:3.0:1788651908.222599:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:11304:x1875537125489920:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788651908.222819:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:11304:x1875537125489920:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 221us (540us total) trans 4294967356 rc 0/0 00000100:00100000:3.0:1788651908.222827:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:2.0:1788651908.226426:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651908.226598:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125490176 00000100:00100000:3.0:1788651908.226618:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125490176 00000100:00100000:3.0:1788651908.226676:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 87 00000100:00100000:3.0:1788651908.226686:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:11304:x1875537125490176:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788651908.226799:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:11304:x1875537125490176:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 114us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651908.226806:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 87 00000100:00100000:1.0:1788651908.240494:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.242241:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125490304 00000100:00100000:2.0:1788651908.242255:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125490304 00000100:00100000:2.0:1788651908.242361:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 88 00000100:00100000:2.0:1788651908.242372:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:11304:x1875537125490304:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651908.242394:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651908.242414:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4244 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cf1 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.242484:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c424b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.242510:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c424b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.242523:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c424b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651908.242568:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651908.242586:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c424b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.242612:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4244 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf1 expref: 23 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.242630:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c424b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf1 expref: 22 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.242639:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:2.0:1788651908.242642:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788651908.242645:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dda00, rc 0) 00000100:00100000:2.0:1788651908.242712:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:11304:x1875537125490304:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 342us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651908.242719:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 88 00000100:00100000:2.0:1788651908.249429:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651908.249568:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125490432 00000100:00100000:3.0:1788651908.249580:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125490432 00000100:00100000:3.0:1788651908.249644:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 35 00000100:00100000:3.0:1788651908.249655:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125490432:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651908.249674:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651908.249699:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000011deceff/0xcd2f56ea038c4252 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cf8 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788651908.249728:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ca983, blocks: 0x0 00010000:00010000:3.0:1788651908.249747:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=364s v=(0 0) 00010000:00010000:3.0:1788651908.249752:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651908.249761:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000011deceff/0xcd2f56ea038c4252 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf8 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.249784:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000011deceff/0xcd2f56ea038c4252 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf8 expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.249797:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906000, rc 0) 00000100:00100000:3.0:1788651908.249881:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125490432:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 229us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651908.250120:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 35 00000100:00100000:1.0:1788651908.262518:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651908.262761:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125490688 00000100:00100000:0.0:1788651908.262773:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125490688 00000100:00100000:0.0:1788651908.262831:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 89 00000100:00100000:0.0:1788651908.262842:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:11304:x1875537125490688:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788651908.263291:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:11304:x1875537125490688:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 449us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.263310:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 89 00000100:00100000:1.0:1788651908.277036:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651908.277165:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125490816 00000100:00100000:0.0:1788651908.277188:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125490816 00000100:00100000:0.0:1788651908.277248:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 36 00000100:00100000:0.0:1788651908.277259:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:11304:x1875537125490816:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651908.277278:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651908.277296:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33cff expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.277328:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000011deceff/0xcd2f56ea038c4252 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf8 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.277338:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651908.277342:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651908.277347:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.277385:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000011deceff/0xcd2f56ea038c4252 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf8 expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.277400:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000011deceff/0xcd2f56ea038c4252 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf8 expref: 7 pid: 8427 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651908.277414:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875537147594880:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651908.277499:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651908.284020:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875537147594880:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651908.284061:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.284102:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97000, rc 0) 00000100:00100000:2.0:1788651908.284166:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:11304:x1875537125490816:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 6908us (7139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651908.284597:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 36 00000100:00100000:1.0:1788651908.284747:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.285077:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125490944 00000100:00100000:2.0:1788651908.285086:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125490944 00010000:00010000:2.0:1788651908.285120:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000011deceff/0xcd2f56ea038c4252 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf8 expref: 7 pid: 8427 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.285153:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:2.0:1788651908.285162:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125490944:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651908.286884:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651908.287003:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000011deceff/0xcd2f56ea038c4252 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf8 expref: 7 pid: 8427 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.287022:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000011deceff/0xcd2f56ea038c4252 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf8 expref: 7 pid: 8427 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.287048:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000011deceff/0xcd2f56ea038c4252 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf8 expref: 7 pid: 8427 timeout: 464 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.287063:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651908.287067:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651908.287076:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.287098:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.287147:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.287162:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6495:1875537147595008:192.168.204.45@tcp:105: 00000100:00100000:2.0:1788651908.287250:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788651908.292367:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb10a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6495:1875537147595008:192.168.204.45@tcp:105: 00010000:00010000:2.0:1788651908.292396:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651908.292459:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125490944:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 7297us (7712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651908.292472:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:1.0:1788651908.293827:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.293957:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125491072 00000100:00100000:2.0:1788651908.293967:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125491072 00002000:00100000:2.0:1788651908.294013:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8f85c3458380 x1875537125491072/t0(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:294/0 lens 504/0 e 0 to 0 dl 1788651919 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651908.294024:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c3458380 with x1875537125491072 ext(0->8) 00002000:00010000:2.0:1788651908.294030:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f85c3458380 00000100:00100000:2.0:1788651908.294057:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:2.0:1788651908.294066:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125491072:12345-192.168.204.45@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788651908.295636:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2388:x1875537125491072:12345-192.168.204.45@tcp:4:lhsmtool_posix.0 Request processed in 1564us (1809us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788651908.295657:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 0 00002000:00100000:2.0:1788651908.295668:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff8f85c3458380 x1875537125491072/t4294967303(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:294/0 lens 504/448 e 0 to 0 dl 1788651919 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651908.295678:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c3458380 with x1875537125491072 ext(0->8) 00002000:00010000:2.0:1788651908.295683:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f85c3458380 00000100:00100000:0.0:1788651908.307177:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651908.310484:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125491200 00000100:00100000:1.0:1788651908.310501:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125491200 00000100:00100000:1.0:1788651908.310561:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 90 00000100:00100000:1.0:1788651908.310571:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:11304:x1875537125491200:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788651908.326799:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1788651908.326818:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788651908.326843:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:0.0:1788651908.326881:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1788651908.326894:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788651908.327038:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11304:x1875537125491200:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 Request processed in 16464us (19867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.327049:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 90 00000100:00100000:3.0:1788651908.329296:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651908.329320:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c3393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147595136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788651908.329388:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651908.329445:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147595136 00000100:00100000:3.0:1788651908.329453:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147595136 00000100:00100000:3.0:1788651908.329511:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788651908.329520:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3390380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147595136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788651908.329644:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788651908.329648:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788651907 00002000:00010000:3.0:1788651908.329650:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788651908.329653:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788651907 -> 1788651907 00002000:00010000:3.0:1788651908.329655:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788651908.329694:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3390380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3635:x1875537147595136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 174us (306us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788651908.329701:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788651908.329720:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788651908.329752:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f86c3393b80/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788651908.329758:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c3393b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147595136:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788651908.336249:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.336266:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.336275:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.336281:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651908.336286:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.336295:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.336313:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:1.0:1788651908.336316:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788651908.336322:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.336329:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c422f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651908.336428:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651908.336475:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125491328 00000100:00100000:1.0:1788651908.336485:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125491328 00000100:00100000:1.0:1788651908.336531:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 38 00000100:00100000:1.0:1788651908.336541:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125491328:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788651908.342285:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788651908.342299:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788651908.342485:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125491328:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 Request processed in 5939us (6054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651908.342496:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 38 00000100:00100000:0.0:1788651908.352285:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651908.352334:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125491584 00000100:00100000:0.0:1788651908.352346:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125491584 00000100:00100000:0.0:1788651908.352407:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 91 00000100:00100000:0.0:1788651908.352418:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:11304:x1875537125491584:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788651908.352476:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651908.352504:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c424b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cf1 expref: 14 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.352534:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:0.0:1788651908.352540:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651908.352570:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.352584:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.352593:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788651908.352713:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000092acf7e8 reply state 00000000f7f6a471 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.352733:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651908.352739:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:0.0:1788651908.352741:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788651908.352743:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788651908.352839:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11304:x1875537125491584:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 423us (565us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1788651908.352845:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 91 00000100:00100000:3.0:1788651908.355457:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.356606:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125491712 00000100:00100000:2.0:1788651908.356619:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125491712 00000100:00100000:2.0:1788651908.356681:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 39 00000100:00100000:2.0:1788651908.356691:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3391f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125491712:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788651908.356849:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788651908.359417:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788651907 -> 1788651906 00002000:00010000:2.0:1788651908.359421:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788651905 00002000:00010000:2.0:1788651908.359424:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788651907 -> 1788651906 00002000:00010000:2.0:1788651908.359426:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788651908.359516:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3391f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125491712:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 2821us (4063us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788651908.359529:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 39 00000100:00100000:0.0:1788651908.375113:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651908.375190:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125491968 00000100:00100000:3.0:1788651908.375200:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125491968 00000100:00100000:3.0:1788651908.375264:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 92 00000100:00100000:3.0:1788651908.375275:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11304:x1875537125491968:12345-192.168.204.45@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788651908.375343:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.375445:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4228 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ce3 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.375456:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.375491:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4228 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ce3 expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.375506:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4228 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ce3 expref: 15 pid: 6511 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651908.375519:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c3391880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147595264:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651908.375735:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952540 going to sleep for 11 seconds 00000100:00100000:0.0:1788651908.389435:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.389527:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c3391880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147595264:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651908.389550:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125492096 00000100:00100000:1.0:1788651908.389558:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125492096 00010000:00010000:2.0:1788651908.389559:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.389609:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4228 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ce3 expref: 16 pid: 6511 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651908.389759:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:1.0:1788651908.389774:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:2388:x1875537125492096:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651908.389790:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651908.389797:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4228 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ce3 expref: 16 pid: 6511 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.389808:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4228 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ce3 expref: 16 pid: 6511 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.389829:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4228 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ce3 expref: 16 pid: 6511 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.389869:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:1.0:1788651908.389874:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.389882:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.389889:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.390006:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651908.390018:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.390028:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.390077:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.390084:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.390101:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.390108:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651908.390114:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.390121:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.390131:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:2.0:1788651908.390135:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788651908.390139:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651908.390141:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:2388:x1875537125492096:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 367us (712us total) trans 0 rc 0/0 00010000:00010000:2.0:1788651908.390152:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c4267 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651908.390157:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:2.0:1788651908.390201:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:11304:x1875537125491968:12345-192.168.204.45@tcp:55:lhsmtool_posix.0 Request processed in 14929us (15099us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788651908.390210:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 92 00000100:00100000:0.0:1788651908.398135:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.398191:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125492224 00000100:00100000:2.0:1788651908.398202:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125492224 00000100:00100000:2.0:1788651908.398274:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 40 00000100:00100000:2.0:1788651908.398297:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125492224:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788651908.398351:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.398373:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.398382:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651908.398387:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651908.398392:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.399061:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.399081:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 7 pid: 8429 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.399172:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875537147595392:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651908.399272:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788651908.411043:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875537147595392:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651908.411075:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788651908.411171:0:14203:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651908.411176:0:14203:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651908.411214:0:14203:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788651908.411220:0:14203:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788651908.411767:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.412291:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125492352 00000100:00100000:2.0:1788651908.412301:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125492352 00010000:00010000:2.0:1788651908.412336:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 8 pid: 8429 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.412379:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 61 00000100:00100000:2.0:1788651908.412389:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2388:x1875537125492352:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651908.412403:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651908.412423:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 8 pid: 8429 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412437:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 8 pid: 8429 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412460:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c4259 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cff expref: 8 pid: 8429 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412475:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651908.412480:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651908.412486:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412496:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412528:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651908.412598:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125492352:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 210us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651908.412605:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 61 00010000:00010000:2.0:1788651908.412641:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412649:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412669:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412677:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412683:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412689:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dde00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788651908.412693:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412701:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412712:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.412718:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a4572017/0xcd2f56ea038c426e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.412773:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125492224:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 Request processed in 14481us (14647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651908.412782:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 40 00000100:00100000:3.0:1788651908.441566:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651908.449995:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125492608 00000100:00100000:1.0:1788651908.450026:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125492608 00000100:00100000:3.0:1788651908.450732:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 93 00000100:00100000:3.0:1788651908.453186:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:11304:x1875537125492608:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788651908.453273:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.453290:0:10110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c40b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c88 expref: 14 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.453320:0:10110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.453368:0:10110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c40b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c88 expref: 14 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.453384:0:10110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c40b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c88 expref: 14 pid: 12192 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651908.453398:0:10110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c3390e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147595520:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651908.453490:0:10110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f09523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651908.456539:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651908.456544:0:10110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c3390e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147595520:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651908.456576:0:10110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.457016:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125492736 00000100:00100000:2.0:1788651908.457024:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125492736 00010000:00010000:2.0:1788651908.457056:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c40b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c88 expref: 15 pid: 12192 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.457412:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 62 00000100:00100000:2.0:1788651908.457423:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:2389:x1875537125492736:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651908.457441:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651908.457448:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c40b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c88 expref: 15 pid: 12192 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.457463:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c40b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c88 expref: 15 pid: 12192 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.457486:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c40b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c88 expref: 15 pid: 12192 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.457503:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651908.457521:0:7919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.457532:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.457539:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.457563:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651908.457618:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:2389:x1875537125492736:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 197us (1090us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651908.457627:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 62 00010000:00010000:2.0:1788651908.457783:0:10110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.457792:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.458418:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.458431:0:10110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c4236 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cea expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.458441:0:10110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.458472:0:10110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c4236 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cea expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.458486:0:10110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c4236 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cea expref: 14 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.458508:0:10110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147595648:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651908.458570:0:10110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788651908.463046:0:10110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147595648:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651908.463080:0:10110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651908.463420:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651908.463467:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125492864 00000100:00100000:3.0:1788651908.463473:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125492864 00010000:00010000:3.0:1788651908.463505:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c4236 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cea expref: 15 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651908.463537:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 63 00000100:00100000:3.0:1788651908.463545:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3392d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:2389:x1875537125492864:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651908.463613:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651908.463622:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c4236 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cea expref: 15 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.463636:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c4236 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cea expref: 15 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.468315:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c4236 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cea expref: 15 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.468341:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:3.0:1788651908.468346:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.468356:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.468365:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.468406:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651908.468474:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3392d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:2389:x1875537125492864:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 4928us (5054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651908.468484:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 63 00010000:00010000:3.0:1788651908.468546:0:10110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.468555:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651908.468684:0:10110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1788651908.468795:0:10110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:3.0:1788651908.469387:0:10110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1788651908.469680:0:10110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10110:1875537147595776:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788651908.469742:0:10110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651908.469781:0:10110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651908.469791:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147595776 00000100:00100000:0.0:1788651908.469800:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147595776 00000100:00100000:0.0:1788651908.469843:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788651908.469863:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10110:x1875537147595776:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788651908.469970:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10110:x1875537147595776:12345-0@lo:1000:mdt00_003.0 Request processed in 118us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.469977:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788651908.470589:0:10110:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788651908.470597:0:10110:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f86c3393b80, transno 4294967304 00000100:00100000:2.0:1788651908.470624:0:10110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10110:1875537147595776:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788651908.470772:0:10110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:2.0:1788651908.470831:0:10110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10110:1875537147595904:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788651908.470895:0:10110:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651908.471100:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147595904 00000100:00100000:2.0:1788651908.471106:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147595904 00000100:00100000:2.0:1788651908.471144:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788651908.471152:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10110:x1875537147595904:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788651908.471444:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10110:x1875537147595904:12345-0@lo:1000:mdt00_003.0 Request processed in 292us (549us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788651908.471452:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788651908.471479:0:10110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788651908.471499:0:10110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb11880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10110:1875537147595904:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788651908.471548:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471557:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471565:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471571:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651908.471577:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471585:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471601:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:2.0:1788651908.471605:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651908.471609:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471616:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c427c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471645:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41b1 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471652:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41b1 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471657:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471671:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651908.471675:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41b1 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471681:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41b1 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471689:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651908.471692:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651908.471695:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41b1 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471701:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c41b1 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471724:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471737:0:10110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cce expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471745:0:10110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471769:0:10110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cce expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.471783:0:10110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cce expref: 17 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.471805:0:10110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147596032:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651908.473632:0:10110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c642c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788651908.474661:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651908.474734:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125492992 00000100:00100000:0.0:1788651908.474744:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125492992 00010000:00010000:0.0:1788651908.474821:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cce expref: 18 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651908.474948:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 64 00000100:00100000:3.0:1788651908.474959:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3391500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:2389:x1875537125492992:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651908.474982:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651908.474988:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cce expref: 18 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.475002:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cce expref: 18 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.475136:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:3.0:1788651908.475142:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.475153:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.475161:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651908.475292:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651908.475352:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3391500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:2389:x1875537125492992:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 396us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651908.475359:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 64 00010000:00010000:2.0:1788651908.476436:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c41cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33cce expref: 17 pid: 6510 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.476457:0:10110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147596032:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651908.476487:0:10110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476496:0:10110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476502:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476514:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476525:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476532:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476538:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651908.476542:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476560:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476575:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651908.476578:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651908.476583:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476589:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4283 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476601:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476606:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476613:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476618:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651908.476621:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476626:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476635:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651908.476637:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788651908.476641:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651908.476658:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c4275 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651908.476881:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3392a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11304:x1875537125492608:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 23733us (35324us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1788651908.476891:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 93 00000020:00080000:2.0:1788651908.476896:0:10110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788651908.477217:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651908.477223:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651908.477242:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788651908.477248:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788651908.485625:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651908.489687:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125493248 00000100:00100000:1.0:1788651908.489706:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125493248 00000100:00100000:1.0:1788651908.489778:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:1.0:1788651908.489788:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11304:x1875537125493248:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788651908.490212:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788651908.490248:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1788651908.490353:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c428a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.490371:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c428a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.490383:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c428a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.490406:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c428a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.490413:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c428a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.490420:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c428a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.490439:0:6513:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788651908.490533:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:11304:x1875537125493248:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 745us (4919us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1788651908.490540:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00000020:00080000:1.0:1788651908.490545:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788651908.490570:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651908.490576:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c428a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.490582:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651908.490586:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c428a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.490593:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c428a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.490607:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:1.0:1788651908.490611:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788651908.490616:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c428a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.490633:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c428a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651908.490644:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651908.490646:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651908.490648:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651908.582542:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147596160:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651908.582618:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.582688:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147596672:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.582717:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.582735:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147597184:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.582759:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.582775:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147597696:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.582795:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.582826:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788651908.582832:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147596288:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.582976:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.583002:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147596800:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583027:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.583047:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147597312:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583067:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.583098:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147596544:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583123:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.583141:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147597056:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583174:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.583193:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147597568:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583212:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.583229:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788651908.583234:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147596416:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583252:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.583268:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147596928:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583286:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.583314:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147597440:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583334:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651908.583359:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147596672 00000100:00100000:0.0:1788651908.583366:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147596672 00000100:00100000:0.0:1788651908.583401:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788651908.583409:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147596672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583460:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147596672:12345-0@lo:400:kworker.0 Request processed in 51us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.583467:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788651908.583484:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147597056 00000100:00100000:0.0:1788651908.583487:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147597056 00000100:00100000:0.0:1788651908.583512:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147597568 00000100:00100000:0.0:1788651908.583515:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147597568 00000100:00100000:0.0:1788651908.583530:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147596416 00000100:00100000:0.0:1788651908.583532:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147596416 00000100:00100000:0.0:1788651908.583542:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147596928 00000100:00100000:0.0:1788651908.583544:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147596928 00000100:00100000:0.0:1788651908.583554:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147597440 00000100:00100000:0.0:1788651908.583555:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147597440 00000100:00100000:0.0:1788651908.583567:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788651908.583573:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147597056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583606:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147597056:12345-0@lo:400:kworker.0 Request processed in 33us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.583612:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788651908.583623:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788651908.583629:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147597568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583654:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147597568:12345-0@lo:400:kworker.0 Request processed in 26us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.583668:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788651908.583681:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788651908.583686:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147596416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583714:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147596416:12345-0@lo:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.583719:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788651908.583729:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788651908.583734:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147596928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583757:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147596928:12345-0@lo:400:kworker.0 Request processed in 23us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.583762:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788651908.583774:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788651908.583779:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147597440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.583803:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147597440:12345-0@lo:400:kworker.0 Request processed in 24us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.583809:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788651908.583827:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147597184 00000100:00100000:0.0:1788651908.583830:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147597184 00000100:00100000:0.0:1788651908.585494:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147597696 00000100:00100000:0.0:1788651908.585503:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147597696 00000100:00100000:0.0:1788651908.585533:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147597312 00000100:00100000:0.0:1788651908.585536:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147597312 00000100:00100000:0.0:1788651908.585551:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788651908.585559:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147597184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.585633:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147597184:12345-0@lo:400:kworker.0 Request processed in 75us (2873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.585649:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788651908.585665:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788651908.585671:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147597696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.585702:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147597696:12345-0@lo:400:kworker.0 Request processed in 32us (2906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.585708:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788651908.585719:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788651908.585725:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1875537147597312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.585752:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3637:x1875537147597312:12345-0@lo:400:kworker.0 Request processed in 27us (2684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.585757:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788651908.585778:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147596288 00000100:00100000:0.0:1788651908.585781:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147596288 00000100:00100000:0.0:1788651908.585820:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788651908.585827:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147596288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651908.586039:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147596160 00000100:00100000:1.0:1788651908.586044:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147596160 00000100:00100000:1.0:1788651908.586082:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788651908.586090:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875537147596160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651908.586105:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1788651908.586545:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3637:x1875537147596160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 455us (3925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651908.586552:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788651908.586627:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147596288:12345-0@lo:400:kworker.0 Request processed in 800us (3649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651908.586635:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:0.0:1788651908.586670:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147596800 00000100:00100000:0.0:1788651908.586675:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147596800 00000100:00100000:0.0:1788651908.586736:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147596544 00000100:00100000:0.0:1788651908.586740:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147596544 00000100:00100000:2.0:1788651908.586778:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788651908.586787:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147596800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651908.586830:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147596800:12345-0@lo:400:kworker.0 Request processed in 45us (3802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651908.586836:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788651908.586873:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788651908.586880:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147596544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651908.586937:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147596544:12345-0@lo:400:kworker.0 Request processed in 58us (3812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651908.586943:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788651908.587229:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147596288:0@lo:400:kworker.0 00000100:00100000:1.0:1788651908.587242:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c88a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147596800:0@lo:400:kworker.0 00000100:00100000:1.0:1788651908.587253:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c88000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147597312:0@lo:400:kworker.0 00000100:00100000:1.0:1788651908.587271:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147596160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651908.587284:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147596672:0@lo:400:kworker.0 00000100:00100000:1.0:1788651908.587297:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147597184:0@lo:400:kworker.0 00000100:00100000:1.0:1788651908.587308:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147597696:0@lo:400:kworker.0 00000100:00100000:1.0:1788651908.587343:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651908.587354:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147597824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651908.587403:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651908.587497:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147597824 00000100:00100000:3.0:1788651908.587503:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147597824 00000100:00100000:3.0:1788651908.587530:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788651908.587543:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147597824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788651908.587557:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788651908.587596:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147597824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651908.587602:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00080000:0.0:1788651908.587620:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651908.587625:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788651908.587629:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651908.587631:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788651908.587633:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147597824:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788651908.587652:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147596416:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.587677:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147596928:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.587689:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147597440:0@lo:400:kworker.0 00000100:00100000:0.0:1788651908.587700:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c89c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147596544:0@lo:400:kworker.0 00010000:00080000:0.0:1788651908.587713:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3c8a300 x1875537147597056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651908.587723:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147597056:0@lo:400:kworker.0 00010000:00080000:0.0:1788651908.587733:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3c88380 x1875537147597568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651908.587740:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147597568:0@lo:400:kworker.0 00010000:00010000:3.0:1788651908.589568:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651909.601535:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651909.602593:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651909.602624:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147597952:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651909.602707:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651909.602896:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147597952 00000100:00100000:1.0:1788651909.602924:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147597952 00000100:00100000:1.0:1788651909.602980:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788651909.602991:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147597952:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651909.603020:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651909.603084:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147597952:12345-0@lo:13:osp-pre-0-1.0 Request processed in 95us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651909.603092:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788651909.603138:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147597952:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651909.605552:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651909.605573:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c3393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147598080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651909.605656:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651909.606310:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147598080 00000100:00100000:3.0:1788651909.606320:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147598080 00000100:00100000:3.0:1788651909.606429:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788651909.606440:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875537147598080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651909.606466:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651909.606520:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875537147598080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651909.606656:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788651909.606720:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c3393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147598080:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788651909.606841:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788651910.443701:0:14254:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651910.443712:0:14254:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651910.443738:0:14254:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788651910.443745:0:14254:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651910.598795:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651910.598895:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125493504 00000100:00100000:2.0:1788651910.598938:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125493504 00000100:00100000:2.0:1788651910.599003:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 94 00000100:00100000:2.0:1788651910.599013:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:11322:x1875537125493504:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651910.599046:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651910.599067:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4291 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d06 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.599183:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4298 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.599198:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4298 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.599212:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4298 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651910.599223:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788651910.599318:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c4291 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d06 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.599334:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4298 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d06 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.599342:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651910.599345:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788651910.599348:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd200, rc 0) 00000100:00100000:2.0:1788651910.599407:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:11322:x1875537125493504:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 396us (623us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788651910.599414:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 94 00000100:00080000:1.0:1788651910.599588:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651910.610209:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651910.610344:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125493632 00000100:00100000:3.0:1788651910.610355:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125493632 00000100:00100000:3.0:1788651910.610446:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 95 00000100:00100000:3.0:1788651910.610457:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:11322:x1875537125493632:12345-192.168.204.45@tcp:34:lfs.0 00010000:00010000:3.0:1788651910.610535:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c42a6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610551:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c42a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610562:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c42a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610585:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610593:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610599:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610675:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42b4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610682:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610689:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651910.610734:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610747:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c42a6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610754:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c42a6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610761:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c42a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610767:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651910.610771:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c42a6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610798:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c42a6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610820:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:3.0:1788651910.610823:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651910.610828:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c42a6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610835:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c42a6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610846:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610852:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610858:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610863:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651910.610866:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610872:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610880:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3368900) 00010000:00010000:3.0:1788651910.610882:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651910.610885:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610901:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610976:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610982:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42b4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610987:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.610993:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651910.610996:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42b4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.611002:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42b4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.611010:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:3.0:1788651910.611012:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651910.611015:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42b4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.611021:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42b4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651910.611096:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:11322:x1875537125493632:12345-192.168.204.45@tcp:34:lfs.0 Request processed in 640us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651910.611104:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 95 00000100:00100000:1.0:1788651910.625118:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c3393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147598208:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788651910.625186:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651910.625299:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147598208 00000100:00100000:3.0:1788651910.625307:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147598208 00000100:00100000:3.0:1788651910.625360:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788651910.625369:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147598208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651910.625403:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651910.625452:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147598208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651910.625459:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788651910.625502:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c3393100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147598208:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788651910.625822:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651910.684825:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651910.684968:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125493888 00000100:00100000:2.0:1788651910.684979:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125493888 00000100:00100000:2.0:1788651910.685035:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 96 00000100:00100000:2.0:1788651910.685060:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:11325:x1875537125493888:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651910.685082:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651910.685110:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c42bb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d0d expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685190:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c42c2 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685218:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c42c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685230:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c42c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685248:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c42c9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685255:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c42c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685262:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c42c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685378:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c42d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685386:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c42d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685393:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c42d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651910.685412:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788651910.685484:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c42c2 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685491:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c42c2 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685497:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c42c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685503:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651910.685507:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c42c2 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685514:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c42c2 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685525:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651910.685528:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651910.685533:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c42c2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685539:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c42c2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685552:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c42c9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685557:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c42c9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685572:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c42c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685577:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651910.685580:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c42c9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685585:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c42c9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685593:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f86d455fa00) 00010000:00010000:2.0:1788651910.685596:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651910.685598:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c42c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685605:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c42c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685646:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c42bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d0d expref: 23 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685660:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c42d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d0d expref: 22 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.685667:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:2.0:1788651910.685669:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651910.685671:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd400, rc 0) 00000100:00100000:2.0:1788651910.685741:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:11325:x1875537125493888:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 684us (939us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788651910.685756:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 96 00000100:00100000:3.0:1788651910.690770:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651910.695459:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125494016 00000100:00100000:2.0:1788651910.695477:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125494016 00000100:00100000:2.0:1788651910.695543:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 97 00000100:00100000:2.0:1788651910.695553:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:11325:x1875537125494016:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:2.0:1788651910.695621:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c42de lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.695638:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c42de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.695649:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c42de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.695683:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c42de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.695690:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c42de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.695696:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c42de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.695702:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651910.695706:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c42de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.695713:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c42de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.695724:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:2.0:1788651910.695741:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651910.695747:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c42de lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.695754:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c42de lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651910.695847:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3393100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:11325:x1875537125494016:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 295us (5088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651910.695856:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 97 00000100:00100000:1.0:1788651910.716597:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651910.716643:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125494272 00000100:00100000:1.0:1788651910.716653:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125494272 00000100:00100000:1.0:1788651910.716718:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:1.0:1788651910.716729:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:11325:x1875537125494272:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:1.0:1788651910.716999:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6efc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:11325:x1875537125494272:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 272us (411us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788651910.717008:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:2.0:1788651910.766823:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651910.766894:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125494528 00000100:00100000:3.0:1788651910.766942:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125494528 00000100:00100000:3.0:1788651910.767013:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 98 00000100:00100000:3.0:1788651910.767024:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:10844:x1875537125494528:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:3.0:1788651910.767052:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651910.767077:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42e5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d14 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.767220:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.767235:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c42d0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d0d expref: 24 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.767244:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.767279:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c42d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d0d expref: 24 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.767309:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c42d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d0d expref: 24 pid: 12192 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651910.767324:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c3393800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875537147598336:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651910.767603:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c39263c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651910.770611:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c3393800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875537147598336:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651910.770641:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651910.771887:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651910.771994:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125494656 00000100:00100000:0.0:1788651910.772012:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125494656 00010000:00010000:0.0:1788651910.772051:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c42d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d0d expref: 25 pid: 12192 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651910.772083:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 65 00000100:00100000:0.0:1788651910.772095:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:2388:x1875537125494656:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651910.772109:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651910.772115:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c42d0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d0d expref: 25 pid: 12192 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.772127:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c42d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d0d expref: 25 pid: 12192 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.772170:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c42d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d0d expref: 25 pid: 12192 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.772183:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:0.0:1788651910.772188:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.772196:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.772203:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.772223:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651910.772280:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:2388:x1875537125494656:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 190us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651910.772290:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 65 00010000:00010000:1.0:1788651910.773039:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.773048:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651910.773068:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788651910.773207:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c42e5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d14 expref: 25 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.773225:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d14 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.773233:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:1.0:1788651910.773236:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788651910.773239:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906e00, rc 0) 00000100:00100000:1.0:1788651910.773287:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:10844:x1875537125494528:12345-192.168.204.45@tcp:101:bash.0 Request processed in 6265us (6489us total) trans 4294967368 rc 0/0 00000100:00100000:1.0:1788651910.773295:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 98 00000100:00100000:2.0:1788651910.784498:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651910.784592:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125494784 00000100:00100000:1.0:1788651910.784601:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125494784 00000100:00100000:1.0:1788651910.784659:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 99 00000100:00100000:1.0:1788651910.784669:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:10844:x1875537125494784:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:1.0:1788651910.784710:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651910.784734:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c42fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d1b expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.784769:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4301 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.784783:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4301 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.784796:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4301 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.784965:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c42fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d1b expref: 26 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.784985:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4301 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d1b expref: 25 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.784994:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:1.0:1788651910.784997:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788651910.785001:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415800, rc 0) 00000100:00100000:1.0:1788651910.785067:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:10844:x1875537125494784:12345-192.168.204.45@tcp:101:bash.0 Request processed in 399us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651910.785074:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 99 00000100:00100000:2.0:1788651910.790382:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651910.790596:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125495040 00000100:00100000:3.0:1788651910.790608:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125495040 00000100:00100000:3.0:1788651910.790670:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 100 00000100:00100000:3.0:1788651910.790680:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:10844:x1875537125495040:12345-192.168.204.45@tcp:36:bash.0 00010000:00010000:3.0:1788651910.790955:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.790974:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.790987:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651910.791031:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1788651910.791054:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000158b7d1d reply state 0000000065645995 transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.791066:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651910.791086:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:3.0:1788651910.791089:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788651910.791093:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788651910.791151:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1788651910.791247:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:10844:x1875537125495040:12345-192.168.204.45@tcp:36:bash.0 Request processed in 567us (874us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788651910.791255:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 100 00000020:00080000:3.0:1788651910.791260:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788651910.794302:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651910.794433:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125495168 00000100:00100000:1.0:1788651910.794444:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125495168 00000100:00100000:1.0:1788651910.794510:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 101 00000100:00100000:1.0:1788651910.794520:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:10844:x1875537125495168:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:1.0:1788651910.794559:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651910.794580:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c430f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d22 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.794637:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c430f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d22 expref: 30 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.794651:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c430f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d22 expref: 30 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.794669:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:1.0:1788651910.794672:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788651910.794676:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414800, rc 0) 00000100:00100000:1.0:1788651910.794731:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3393800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:10844:x1875537125495168:12345-192.168.204.45@tcp:101:bash.0 Request processed in 212us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651910.794737:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 101 00000100:00100000:1.0:1788651910.800063:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651910.800200:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125495296 00000100:00100000:0.0:1788651910.800213:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125495296 00000100:00100000:0.0:1788651910.800288:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 41 00000100:00100000:0.0:1788651910.800299:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:10844:x1875537125495296:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788651910.800317:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651910.800339:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c4316 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d29 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788651910.800363:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ca982, atime: 0x6a9ca981, ctime: 0x6a9ca982, blocks: 0x8 00010000:00010000:0.0:1788651910.800385:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1788651910.800406:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651910.800415:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c4316 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d29 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.800436:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c4316 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d29 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.800451:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96c00, rc 0) 00000100:00100000:0.0:1788651910.800516:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:10844:x1875537125495296:12345-192.168.204.45@tcp:101:bash.0 Request processed in 219us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651910.800522:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 41 00000100:00080000:1.0:1788651910.801392:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651910.803387:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651910.803492:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125495424 00000100:00100000:1.0:1788651910.803503:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125495424 00002000:00010000:1.0:1788651910.803548:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788651910.803553:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c3cbdc00 with x1875537125495424 ext(0->18446744073709551615) 00002000:00010000:1.0:1788651910.803563:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f85c3cbdc00. 00000100:00100000:1.0:1788651910.803601:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:1.0:1788651910.803611:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125495424:12345-192.168.204.45@tcp:10:bash.0 00002000:00010000:1.0:1788651910.803991:0:8432:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788651910.803995:0:8432:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788651906 -> 1788651910 00002000:00010000:1.0:1788651910.804325:0:8432:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788651905 -> 1788651905 00002000:00010000:1.0:1788651910.804327:0:8432:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788651906 -> 1788651910 00002000:00010000:1.0:1788651910.804330:0:8432:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1788651910.804462:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2388:x1875537125495424:12345-192.168.204.45@tcp:10:bash.0 Request processed in 851us (1084us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788651910.804472:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 1 00002000:00010000:1.0:1788651910.804475:0:8432:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:1.0:1788651910.804478:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c3cbdc00 with x1875537125495424 ext(0->18446744073709551615) 00002000:00010000:1.0:1788651910.804483:0:8432:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f85c3cbdc00. 00000100:00100000:3.0:1788651910.899490:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651910.899950:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125495552 00000100:00100000:2.0:1788651910.899965:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125495552 00000100:00100000:2.0:1788651910.900046:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 102 00000100:00100000:2.0:1788651910.900057:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:11339:x1875537125495552:12345-192.168.204.45@tcp:34:lfs.0 00010000:00010000:2.0:1788651910.900149:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c431d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900168:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c431d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900181:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c431d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900196:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4324 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900220:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4324 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900227:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4324 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900300:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c432b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900515:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c432b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900529:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c432b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651910.900583:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c432b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900595:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c431d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900607:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c431d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900613:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c431d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900618:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dda00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651910.900621:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c431d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900628:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c431d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900647:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651910.900650:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651910.900656:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c431d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900662:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c431d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900676:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4324 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900682:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4324 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900695:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4324 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900703:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651910.900706:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4324 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900711:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4324 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900721:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f86d455fa00) 00010000:00010000:2.0:1788651910.900723:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651910.900725:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4324 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900730:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4324 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900761:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c432b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900767:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c432b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900772:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c432b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900859:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dde00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651910.900863:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c432b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900869:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c432b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900878:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:2.0:1788651910.900881:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651910.900884:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c432b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651910.900895:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c432b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651910.901251:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3393b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:11339:x1875537125495552:12345-192.168.204.45@tcp:34:lfs.0 Request processed in 1192us (1769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651910.901260:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 102 00000100:00100000:2.0:1788651910.957726:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651910.957883:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125495808 00000100:00100000:1.0:1788651910.957895:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125495808 00000100:00100000:1.0:1788651910.957993:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 103 00000100:00100000:1.0:1788651910.958003:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:11342:x1875537125495808:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:1.0:1788651910.958027:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651910.958051:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4332 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d30 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958135:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4339 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958151:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4339 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958163:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4339 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958179:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4340 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958206:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4340 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958213:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4340 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958342:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4347 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958352:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4347 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958362:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4347 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651910.958371:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788651910.958449:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4339 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958456:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4339 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958461:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4339 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958467:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651910.958471:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4339 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958478:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4339 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958500:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:1.0:1788651910.958502:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651910.958507:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4339 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958513:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4339 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958528:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4340 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958535:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4340 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958540:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4340 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958545:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651910.958548:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4340 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958554:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4340 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958561:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3374e00) 00010000:00010000:1.0:1788651910.958563:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651910.958565:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4340 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958571:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4340 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958620:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4332 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d30 expref: 33 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958634:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4347 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d30 expref: 32 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651910.958642:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:1.0:1788651910.958644:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788651910.958647:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1503000, rc 0) 00000100:00100000:1.0:1788651910.958712:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:11342:x1875537125495808:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 710us (997us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1788651910.958720:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 103 00000100:00100000:3.0:1788651910.961998:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651910.962793:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125495936 00000100:00100000:0.0:1788651910.962814:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125495936 00000100:00100000:0.0:1788651910.962881:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 104 00000100:00100000:0.0:1788651910.962892:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:11342:x1875537125495936:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:0.0:1788651910.962990:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.963009:0:10110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d14 expref: 32 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.963020:0:10110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.963058:0:10110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d14 expref: 32 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.963071:0:10110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d14 expref: 32 pid: 6509 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651910.963123:0:10110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147598464:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651910.964441:0:10110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c62806c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651910.966166:0:10110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147598464:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651910.966199:0:10110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651910.975528:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651910.976379:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125496192 00000100:00100000:1.0:1788651910.976392:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125496192 00000100:00100000:1.0:1788651910.976466:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:1.0:1788651910.976476:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+33:6164:x1875537125496192:12345-192.168.204.45@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788651910.977252:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:6164:x1875537125496192:12345-192.168.204.45@tcp:35:ldlm_bl.0 Request processed in 772us (1735us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788651910.977260:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:3.0:1788651910.981482:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651910.981712:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125496320 00000100:00100000:0.0:1788651910.981724:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125496320 00010000:00010000:0.0:1788651910.981767:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d14 expref: 34 pid: 6509 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651910.981818:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 66 00000100:00100000:0.0:1788651910.981829:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:2389:x1875537125496320:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651910.981846:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651910.981854:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d14 expref: 34 pid: 6509 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.981867:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d14 expref: 34 pid: 6509 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.981889:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c42ec lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d14 expref: 34 pid: 6509 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982015:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:0.0:1788651910.982022:0:7919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982049:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982058:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982089:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651910.982168:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+33:2389:x1875537125496320:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 341us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651910.982177:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 66 00010000:00010000:0.0:1788651910.982294:0:10110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982303:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982344:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982350:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982356:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982361:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651910.982365:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982373:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982388:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:0.0:1788651910.982390:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651910.982394:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651910.982400:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4355 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651910.982451:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3390e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:11342:x1875537125495936:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 19560us (20463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651910.982460:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 104 00000100:00100000:3.0:1788651910.987424:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651910.987526:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125496576 00000100:00100000:0.0:1788651910.987537:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125496576 00000100:00100000:0.0:1788651910.987618:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:0.0:1788651910.987630:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:11342:x1875537125496576:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:0.0:1788651910.987900:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+33:11342:x1875537125496576:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 272us (486us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788651910.987946:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:0.0:1788651911.095011:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.095161:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125496832 00000100:00100000:2.0:1788651911.095172:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125496832 00000100:00100000:2.0:1788651911.095244:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 105 00000100:00100000:2.0:1788651911.095254:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+33:11353:x1875537125496832:12345-192.168.204.45@tcp:101:cat.0 00010000:00010000:2.0:1788651911.095278:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651911.095300:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c435c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d37 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095371:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4363 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095386:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4363 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095399:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4363 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095414:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c436a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095422:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c436a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095428:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c436a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095541:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c4371 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095551:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c4371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095558:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c4371 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651911.095579:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788651911.095665:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4363 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095672:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4363 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095678:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4363 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095684:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651911.095689:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4363 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095696:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4363 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095708:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651911.095711:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651911.095715:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4363 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095722:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4363 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095735:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c436a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095742:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c436a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095757:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c436a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095763:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dde00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651911.095767:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c436a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095773:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c436a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095782:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f86d455fa00) 00010000:00010000:2.0:1788651911.095784:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651911.095787:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c436a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095792:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c436a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095842:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c435c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d37 expref: 36 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095855:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c4371 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d37 expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.095862:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:2.0:1788651911.095865:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651911.095867:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd600, rc 0) 00000100:00100000:2.0:1788651911.096252:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:11353:x1875537125496832:12345-192.168.204.45@tcp:101:cat.0 Request processed in 999us (1250us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788651911.096268:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 105 00000100:00100000:0.0:1788651911.101347:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651911.101433:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125497088 00000100:00100000:1.0:1788651911.101443:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125497088 00000100:00100000:1.0:1788651911.101499:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:1.0:1788651911.101510:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:11353:x1875537125497088:12345-192.168.204.45@tcp:35:cat.0 00000100:00100000:1.0:1788651911.101901:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+36:11353:x1875537125497088:12345-192.168.204.45@tcp:35:cat.0 Request processed in 391us (563us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788651911.101987:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:1.0:1788651911.135611:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.135707:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125497344 00000100:00100000:2.0:1788651911.135718:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125497344 00000100:00100000:2.0:1788651911.135789:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 106 00000100:00100000:2.0:1788651911.135809:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+36:11354:x1875537125497344:12345-192.168.204.45@tcp:36:rm.0 00010000:00010000:2.0:1788651911.135866:0:12192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788651911.135893:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c430f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d22 expref: 36 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.135976:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c4371 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d37 expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.135988:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4347 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d30 expref: 34 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.136002:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4301 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d1b expref: 33 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.136017:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:2.0:1788651911.136022:0:12192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651911.136046:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c437f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.136062:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c437f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.136072:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c437f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.136102:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.136110:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.136118:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.136205:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c438d lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.136214:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c438d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.136220:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c438d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788651911.136431:0:12192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788651911.136440:0:12192:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367071531909ns, next at 368071529590ns, rc = 0 00010000:00010000:2.0:1788651911.137712:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c4394 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.137730:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c4394 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.137740:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c4394 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.137748:0:12192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c4394 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.137764:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c4394 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.137904:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c4394 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.137977:0:12192:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651911.137999:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c438d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138006:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c438d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138012:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c438d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138018:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651911.138023:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c438d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138031:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c438d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138042:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:2.0:1788651911.138045:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788651911.138050:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c438d lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138056:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c438d lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138075:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c437f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138088:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c437f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138094:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c437f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138099:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dda00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651911.138102:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c437f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138109:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c437f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138117:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651911.138120:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651911.138123:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c437f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138128:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c437f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651911.138138:0:12192:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cc2ac3a reply state 00000000427ca36a transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138148:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.138154:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f86d455fa00) 00010000:00010000:2.0:1788651911.138156:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651911.138159:0:12192:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651911.138264:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:11354:x1875537125497344:12345-192.168.204.45@tcp:36:rm.0 Request processed in 2461us (2659us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788651911.138278:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 106 00000001:00080000:1.0:1788651911.140729:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1788651911.140748:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:3.0:1788651911.143616:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651911.143632:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c4394 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.143644:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788651911.143649:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c4394 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.143659:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c4394 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.143677:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:3.0:1788651911.143681:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788651911.143685:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c4394 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.143712:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c4394 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.144016:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651911.144019:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651911.144021:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651911.202705:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.203078:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125497600 00000100:00100000:2.0:1788651911.203089:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125497600 00000100:00100000:2.0:1788651911.203991:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 107 00000100:00100000:2.0:1788651911.204006:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:11360:x1875537125497600:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651911.204033:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651911.204059:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c439b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d3e expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.204184:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43a2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.204201:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.204213:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.204225:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.204232:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.204239:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788651911.204588:0:10110:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:2.0:1788651911.204744:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c43b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.204754:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c43b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.204762:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c43b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.205060:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43a2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.205069:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43a2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.205075:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.205081:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651911.205085:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43a2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.205093:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43a2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.205105:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651911.205108:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651911.205112:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43a2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.205132:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43a2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651911.205149:0:10110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000504f2e4d reply state 000000002be37fd3 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.205160:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.205167:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f86d455fa00) 00010000:00010000:2.0:1788651911.205169:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651911.205172:0:10110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788651911.205204:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c439b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d3e expref: 37 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.205219:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c43b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d3e expref: 36 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.205225:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f86d455fe00) 00010000:00010000:2.0:1788651911.205227:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651911.205230:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd400, rc 0) 00000100:00100000:2.0:1788651911.205381:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:11360:x1875537125497600:12345-192.168.204.45@tcp:101:bash.0 Request processed in 1378us (2687us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788651911.205389:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 107 00000100:00100000:0.0:1788651911.212500:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.213987:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125497728 00000100:00100000:2.0:1788651911.214002:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125497728 00000100:00100000:2.0:1788651911.214142:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 42 00000100:00100000:2.0:1788651911.214153:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125497728:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651911.214192:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651911.214215:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c8d323a/0xcd2f56ea038c43be lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d45 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651911.214240:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788651911.214259:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=367s v=(0 0) 00010000:00010000:2.0:1788651911.214264:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651911.214273:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c8d323a/0xcd2f56ea038c43be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d45 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.214293:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006c8d323a/0xcd2f56ea038c43be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d45 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.214308:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dca00, rc 0) 00000100:00100000:2.0:1788651911.214390:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125497728:12345-192.168.204.45@tcp:101:bash.0 Request processed in 239us (4762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651911.214397:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 42 00000100:00080000:1.0:1788651911.215496:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651911.217632:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651911.221040:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125497856 00000100:00100000:0.0:1788651911.221060:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125497856 00000100:00100000:0.0:1788651911.221143:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 43 00000100:00100000:0.0:1788651911.221153:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:11360:x1875537125497856:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788651911.221189:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651911.221209:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d4c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.221242:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006c8d323a/0xcd2f56ea038c43be lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d45 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.221251:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651911.221255:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651911.221260:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.221298:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006c8d323a/0xcd2f56ea038c43be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d45 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.221312:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006c8d323a/0xcd2f56ea038c43be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d45 expref: 7 pid: 8429 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651911.221326:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875537147598592:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651911.221668:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c62809c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651911.224489:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875537147598592:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651911.224544:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.224570:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96200, rc 0) 00000100:00100000:2.0:1788651911.224656:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:11360:x1875537125497856:12345-192.168.204.45@tcp:101:bash.0 Request processed in 3503us (7032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651911.224667:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 43 00000100:00100000:3.0:1788651911.226738:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651911.227354:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125497984 00000100:00100000:0.0:1788651911.227366:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125497984 00010000:00010000:0.0:1788651911.227409:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006c8d323a/0xcd2f56ea038c43be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d45 expref: 7 pid: 8429 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651911.227455:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00100000:0.0:1788651911.227478:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125497984:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651911.227494:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651911.227518:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006c8d323a/0xcd2f56ea038c43be lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d45 expref: 7 pid: 8429 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.227532:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006c8d323a/0xcd2f56ea038c43be lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d45 expref: 7 pid: 8429 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.227557:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c8d323a/0xcd2f56ea038c43be lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d45 expref: 7 pid: 8429 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.227574:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651911.227578:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651911.227588:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.227599:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.227649:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651911.227663:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6495:1875537147598720:192.168.204.45@tcp:105: 00000100:00100000:0.0:1788651911.227747:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651911.235948:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:6495:1875537147598720:192.168.204.45@tcp:105: 00010000:00010000:0.0:1788651911.236005:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651911.236079:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125497984:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 8603us (9350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651911.236092:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00100000:1.0:1788651911.238216:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.238382:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125498240 00000100:00100000:2.0:1788651911.238393:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125498240 00000100:00100000:2.0:1788651911.238451:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:2.0:1788651911.238461:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:11360:x1875537125498240:12345-192.168.204.45@tcp:35:bash.0 00000100:00100000:2.0:1788651911.238749:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:11360:x1875537125498240:12345-192.168.204.45@tcp:35:bash.0 Request processed in 289us (542us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788651911.238756:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:1.0:1788651911.440969:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.441064:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125498368 00000100:00100000:2.0:1788651911.441076:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125498368 00000100:00100000:2.0:1788651911.441149:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 108 00000100:00100000:2.0:1788651911.441161:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:11376:x1875537125498368:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651911.441187:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651911.441208:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c43cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d53 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.441304:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.441320:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.441333:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651911.441390:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788651911.441394:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651911.441414:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.441439:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c43cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d53 expref: 40 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.441468:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d53 expref: 39 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.441476:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651911.441479:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651911.441483:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc000, rc 0) 00000100:00100000:2.0:1788651911.441563:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:11376:x1875537125498368:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 403us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651911.441570:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 108 00000100:00100000:3.0:1788651911.445336:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.445817:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125498624 00000100:00100000:2.0:1788651911.445829:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125498624 00000100:00100000:2.0:1788651911.445893:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 109 00000100:00100000:2.0:1788651911.445903:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:11376:x1875537125498624:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651911.445945:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651911.445970:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c43da lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d5a expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.446098:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c43e1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.446114:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c43e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.446126:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c43e1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651911.446137:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788651911.446260:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c43da lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d5a expref: 42 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.446278:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c43e1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d5a expref: 41 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.446288:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f86d455fe00) 00010000:00010000:2.0:1788651911.446291:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651911.446294:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dd800, rc 0) 00000100:00100000:2.0:1788651911.447622:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:11376:x1875537125498624:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 1714us (2290us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788651911.447632:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 109 00000100:00100000:1.0:1788651911.465836:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651911.465950:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651911.466454:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125499008 00000100:00100000:0.0:1788651911.466463:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125499008 00000100:00100000:0.0:1788651911.466542:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:0.0:1788651911.466552:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:2390:x1875537125499008:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651911.466569:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651911.466594:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c43e1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d5a expref: 41 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.466612:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f86d455fe00) 00010000:00010000:0.0:1788651911.466617:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651911.466683:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:2390:x1875537125499008:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 133us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651911.466691:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:2.0:1788651911.467361:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125498880 00000100:00100000:2.0:1788651911.467369:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125498880 00000100:00100000:2.0:1788651911.467653:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 110 00000100:00100000:2.0:1788651911.467662:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:11376:x1875537125498880:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651911.467686:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651911.467702:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c43ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d61 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.467810:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c43f6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.467824:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.467835:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c43f6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651911.467867:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788651911.467995:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c43ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d61 expref: 43 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.468012:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c43f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d61 expref: 42 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.468020:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f86d455fe00) 00010000:00010000:2.0:1788651911.468022:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788651911.468025:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dda00, rc 0) 00000100:00100000:2.0:1788651911.468076:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+42:11376:x1875537125498880:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 416us (2252us total) trans 4294967381 rc 0/0 00000100:00100000:2.0:1788651911.468082:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 110 00000100:00100000:1.0:1788651911.474394:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.474579:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125499136 00000100:00100000:2.0:1788651911.474593:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125499136 00000100:00100000:2.0:1788651911.474654:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 44 00000100:00100000:2.0:1788651911.474667:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125499136:12345-192.168.204.45@tcp:1:lfs.0 00010000:00010000:2.0:1788651911.474713:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.474736:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.474746:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651911.474750:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651911.474755:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.474811:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.474825:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 6 pid: 8428 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651911.474839:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1875537147598848:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651911.474944:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788651911.477114:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8429:1875537147598848:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651911.477153:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651911.478903:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.479073:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125499264 00000100:00100000:2.0:1788651911.479084:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125499264 00002000:00100000:2.0:1788651911.479149:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8f85c3c89f80 x1875537125499264/t0(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:297/0 lens 504/0 e 0 to 0 dl 1788651922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651911.479161:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c3c89f80 with x1875537125499264 ext(0->8) 00010000:00010000:2.0:1788651911.479173:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 7 pid: 8428 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.479192:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 7 pid: 8428 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651911.479199:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f85c3c89f80 00000100:00100000:2.0:1788651911.479243:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:2.0:1788651911.479253:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125499264:12345-192.168.204.45@tcp:4:lfs.0 00000100:00100000:3.0:1788651911.489022:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2389:x1875537125499264:12345-192.168.204.45@tcp:4:lfs.0 Request processed in 9756us (10112us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788651911.489043:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 1 00002000:00100000:3.0:1788651911.489059:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff8f85c3c89f80 x1875537125499264/t4294967303(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:297/0 lens 504/448 e 0 to 0 dl 1788651922 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651911.489069:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c3c89f80 with x1875537125499264 ext(0->8) 00010000:00010000:3.0:1788651911.489081:0:8434:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 9 pid: 8428 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.489112:0:8434:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 9 pid: 8428 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788651911.489121:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f85c3c89f80 00000100:00100000:1.0:1788651911.497461:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651911.497983:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125499392 00000100:00100000:3.0:1788651911.497995:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125499392 00010000:00010000:3.0:1788651911.498040:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 9 pid: 8428 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651911.498074:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 68 00000100:00100000:3.0:1788651911.498083:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2390:x1875537125499392:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651911.498114:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788651911.498134:0:6496:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788651911.498138:0:6496:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788651910 00002000:00010000:3.0:1788651911.498140:0:6496:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788651911 00002000:00010000:3.0:1788651911.498143:0:6496:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788651910 00002000:00010000:3.0:1788651911.498145:0:6496:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:3.0:1788651911.498152:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 9 pid: 8428 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.498167:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 9 pid: 8428 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.498189:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fea1aeb2/0xcd2f56ea038c43c5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d4c expref: 9 pid: 8428 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.498204:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651911.498208:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651911.498215:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.498225:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.498260:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651911.498320:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2390:x1875537125499392:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 237us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651911.498328:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 68 00010000:00010000:2.0:1788651911.498799:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.498811:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.498833:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.498841:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.498848:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.498854:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788651911.498859:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.498869:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.498880:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.498899:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0270307/0xcd2f56ea038c4404 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651911.498973:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125499136:12345-192.168.204.45@tcp:1:lfs.0 Request processed in 24310us (24597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651911.498981:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 44 00000100:00100000:1.0:1788651911.502325:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.502511:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125499648 00000100:00100000:2.0:1788651911.502522:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125499648 00000100:00100000:2.0:1788651911.502586:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:2.0:1788651911.502596:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+42:11376:x1875537125499648:12345-192.168.204.45@tcp:35:lfs.0 00000004:00010000:2.0:1788651911.502664:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c43f6 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d61 expref: 42 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651911.502942:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788651911.502979:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788651911.503295:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788651911.503334:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.503348:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c43b0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d3e expref: 46 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.503357:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.503392:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c43b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d3e expref: 46 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.503417:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c43b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d3e expref: 46 pid: 10110 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651911.503432:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6513:1875537147598976:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651911.503522:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788651911.514587:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651911.514696:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125499776 00000100:00100000:0.0:1788651911.514706:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125499776 00010000:00010000:0.0:1788651911.514749:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c43b0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d3e expref: 47 pid: 10110 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651911.514801:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:0.0:1788651911.514823:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+47:2388:x1875537125499776:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651911.514838:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651911.514845:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c43b0 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d3e expref: 47 pid: 10110 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.514873:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c43b0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d3e expref: 47 pid: 10110 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.514897:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f86d455fe00) 00010000:00010000:0.0:1788651911.514902:0:7919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.514932:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.514940:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.514961:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651911.515135:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c43b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d3e expref: 47 pid: 10110 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651911.515153:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6513:1875537147598976:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651911.515175:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.515184:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.515190:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788651911.515337:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:3.0:1788651911.515455:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:3.0:1788651911.515541:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1875537147599104:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788651911.517035:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+48:2388:x1875537125499776:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 2209us (2443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651911.517050:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:3.0:1788651911.519594:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651911.519756:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3926d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651911.519810:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147599104 00000100:00100000:1.0:1788651911.519820:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147599104 00000100:00100000:1.0:1788651911.519939:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788651911.519949:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1875537147599104:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788651911.520455:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6513:x1875537147599104:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 507us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651911.520463:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788651911.520549:0:6513:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1788651911.520555:0:6513:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1788651911.520575:0:6513:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f85c2831f80, transno 4294967302 00000100:00100000:2.0:1788651911.520593:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0dc00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1875537147599104:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788651911.520776:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788651911.520861:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1875537147599232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788651911.520900:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651911.521128:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2583240 going to sleep for 11 seconds 00000100:00100000:3.0:1788651911.521182:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147599232 00000100:00100000:3.0:1788651911.521188:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147599232 00000100:00100000:3.0:1788651911.521232:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788651911.521240:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1875537147599232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788651911.521383:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6513:x1875537147599232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 144us (482us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788651911.521390:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788651911.521538:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1875537147599232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788651911.521589:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788651911.521638:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.521648:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.521656:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.521662:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651911.521667:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.521693:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.521711:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f86d455fe00) 00010000:00010000:2.0:1788651911.521714:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788651911.521719:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.521726:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c440b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788651911.521825:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788651911.521889:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788651911.521899:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367456990597ns, next at 368456988535ns, rc = 0 00000001:00080000:2.0:1788651911.521905:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788651911.521961:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f86d455fe00) 00010000:00010000:2.0:1788651911.521964:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788651911.521972:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c43f6 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d61 expref: 50 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651911.522068:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6ec050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+49:11376:x1875537125499648:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 19473us (19753us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788651911.522076:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 26 00000020:00080000:2.0:1788651911.522081:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:0.0:1788651911.523743:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651911.528715:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651911.528880:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125499904 00000100:00100000:3.0:1788651911.528891:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125499904 00000100:00100000:3.0:1788651911.528970:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 111 00000100:00100000:3.0:1788651911.528981:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+49:11376:x1875537125499904:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651911.529018:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651911.529041:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4412 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d68 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.529095:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4412 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d68 expref: 50 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.529117:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4412 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d68 expref: 50 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.529137:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:3.0:1788651911.529140:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651911.529144:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907200, rc 0) 00000100:00100000:0.0:1788651911.532860:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+50:11376:x1875537125499904:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 3864us (4139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651911.532874:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 111 00000100:00100000:3.0:1788651911.539257:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651911.539358:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125500160 00000100:00100000:1.0:1788651911.539382:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125500160 00000100:00100000:1.0:1788651911.539441:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 27 00000100:00100000:1.0:1788651911.539458:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+50:11376:x1875537125500160:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:1.0:1788651911.539746:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+51:11376:x1875537125500160:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 294us (501us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788651911.539754:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 27 00010000:00010000:2.0:1788651911.651260:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651911.662021:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.662177:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125500288 00000100:00100000:2.0:1788651911.662188:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125500288 00000100:00100000:2.0:1788651911.662253:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 112 00000100:00100000:2.0:1788651911.662265:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+51:11386:x1875537125500288:12345-192.168.204.45@tcp:34:lfs.0 00010000:00010000:2.0:1788651911.662363:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4419 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662381:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662393:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662406:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4420 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662412:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662418:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662493:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4427 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662502:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662509:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651911.662557:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662571:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4419 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662589:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4419 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662595:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4419 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662601:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dda00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651911.662605:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4419 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662613:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4419 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.662624:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651911.662627:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651911.662632:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4419 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663085:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4419 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663101:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4420 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663107:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4420 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663114:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4420 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663119:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651911.663129:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4420 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663136:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4420 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663145:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f86d455fa00) 00010000:00010000:2.0:1788651911.663148:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651911.663152:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4420 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663158:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4420 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663168:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4427 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663173:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4427 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663177:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4427 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663181:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651911.663184:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4427 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663189:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4427 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663196:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651911.663198:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651911.663208:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4427 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.663214:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4427 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651911.663361:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+51:11386:x1875537125500288:12345-192.168.204.45@tcp:34:lfs.0 Request processed in 1096us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651911.663369:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 112 00000100:00100000:3.0:1788651911.740408:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651911.744036:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125500544 00000100:00100000:0.0:1788651911.744053:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125500544 00000100:00100000:0.0:1788651911.744123:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 113 00000100:00100000:0.0:1788651911.744135:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+51:11389:x1875537125500544:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651911.744156:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651911.744177:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c442e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d6f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744267:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4435 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744283:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4435 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744295:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4435 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744306:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c443c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744314:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c443c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744321:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c443c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744431:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c4443 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744440:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c4443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744448:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c4443 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651911.744457:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788651911.744535:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4435 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744543:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4435 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744556:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4435 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744562:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651911.744566:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4435 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744575:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4435 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744587:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:0.0:1788651911.744590:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651911.744595:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4435 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744602:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c4435 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744618:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c443c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744624:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c443c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744630:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c443c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744635:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651911.744639:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c443c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744656:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c443c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744664:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f86d455fa00) 00010000:00010000:0.0:1788651911.744667:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651911.744670:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c443c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744676:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c443c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744712:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c442e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d6f expref: 54 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744727:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c4443 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d6f expref: 53 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.744735:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:0.0:1788651911.744737:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651911.744739:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96000, rc 0) 00000100:00100000:0.0:1788651911.744829:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+53:11389:x1875537125500544:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 696us (4430us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788651911.744837:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 113 00000100:00100000:1.0:1788651911.750782:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651911.750881:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125500672 00000100:00100000:0.0:1788651911.750891:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125500672 00000100:00100000:0.0:1788651911.750992:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 114 00000100:00100000:0.0:1788651911.751005:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+53:11389:x1875537125500672:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:0.0:1788651911.751099:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4451 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.751114:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4451 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.751126:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4451 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.751159:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4451 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.751166:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4451 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.751172:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4451 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.751177:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651911.751181:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4451 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.751188:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4451 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.751200:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:0.0:1788651911.751203:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651911.751208:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4451 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.751214:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4451 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651911.751299:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+53:11389:x1875537125500672:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 298us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651911.751307:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 114 00000100:00100000:1.0:1788651911.755147:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651911.755239:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125500928 00000100:00100000:0.0:1788651911.755249:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125500928 00000100:00100000:0.0:1788651911.755310:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:0.0:1788651911.755329:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+53:11389:x1875537125500928:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:0.0:1788651911.755578:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+54:11389:x1875537125500928:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 258us (440us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1788651911.755586:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:3.0:1788651911.864995:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.865128:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125501184 00000100:00100000:2.0:1788651911.865138:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125501184 00000100:00100000:2.0:1788651911.865208:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 115 00000100:00100000:2.0:1788651911.865218:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+54:11399:x1875537125501184:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651911.865243:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651911.865245:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788651911.865271:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c43d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d53 expref: 54 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.865289:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651911.865294:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651911.865308:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4458 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d76 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.865418:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c445f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.865431:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c445f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.865441:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c445f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651911.865466:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788651911.865571:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c4458 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d76 expref: 56 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.865585:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c445f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d76 expref: 55 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.865592:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651911.865595:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651911.865598:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc600, rc 0) 00000100:00100000:2.0:1788651911.865712:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+55:11399:x1875537125501184:12345-192.168.204.45@tcp:101:bash.0 Request processed in 495us (727us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788651911.865720:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 115 00000100:00100000:1.0:1788651911.886529:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651911.886632:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125501312 00000100:00100000:2.0:1788651911.886643:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125501312 00000100:00100000:2.0:1788651911.886705:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 116 00000100:00100000:2.0:1788651911.886715:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+55:11399:x1875537125501312:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651911.886740:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651911.886760:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c446d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d7d expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.886805:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4474 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.886820:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4474 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.886849:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4474 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.886996:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c446d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d7d expref: 57 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.887014:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4474 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d7d expref: 56 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.887022:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651911.887025:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788651911.887028:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc000, rc 0) 00000100:00100000:2.0:1788651911.887093:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+56:11399:x1875537125501312:12345-192.168.204.45@tcp:101:bash.0 Request processed in 379us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651911.887376:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 116 00000100:00100000:1.0:1788651911.893464:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651911.893553:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651911.893648:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125501696 00000100:00100000:3.0:1788651911.893659:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125501696 00000100:00100000:3.0:1788651911.893730:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:3.0:1788651911.893740:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+56:2389:x1875537125501696:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651911.893755:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651911.893780:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c445f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d76 expref: 56 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651911.893810:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:3.0:1788651911.893814:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651911.893873:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+55:2389:x1875537125501696:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 135us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651911.893896:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:2.0:1788651911.895876:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125501568 00000100:00100000:2.0:1788651911.895889:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125501568 00000100:00100000:2.0:1788651911.896190:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 117 00000100:00100000:2.0:1788651911.896210:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+55:11399:x1875537125501568:12345-192.168.204.45@tcp:36:bash.0 00010000:00010000:2.0:1788651911.896267:0:10110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651911.896294:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c4443 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d6f expref: 55 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.896314:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651911.896319:0:10110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651911.896495:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.896522:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.896533:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651911.896578:0:10110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788651911.896616:0:10110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000046cfd991 reply state 000000004d333fe9 transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.896629:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651911.896635:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651911.896637:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651911.896640:0:10110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651911.896736:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+57:11399:x1875537125501568:12345-192.168.204.45@tcp:36:bash.0 Request processed in 538us (3283us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788651911.896743:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 117 00000020:00080000:2.0:1788651911.896748:0:10110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788651911.901282:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651911.901607:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125501824 00000100:00100000:0.0:1788651911.901617:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125501824 00000100:00100000:0.0:1788651911.901675:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 118 00000100:00100000:0.0:1788651911.901685:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+57:11399:x1875537125501824:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788651911.901710:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651911.901730:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4482 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d84 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.901829:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.901843:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.901855:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651911.901903:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788651911.902010:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788651911.902033:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.902059:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4482 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d84 expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.902079:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d84 expref: 58 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651911.902087:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:0.0:1788651911.902090:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651911.902093:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96800, rc 0) 00000100:00100000:0.0:1788651911.902319:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+58:11399:x1875537125501824:12345-192.168.204.45@tcp:101:bash.0 Request processed in 635us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651911.902327:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 118 00000100:00100000:3.0:1788651911.908412:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651911.908472:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125502080 00000100:00100000:0.0:1788651911.908483:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125502080 00000100:00100000:0.0:1788651911.908542:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:0.0:1788651911.908552:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+58:11399:x1875537125502080:12345-192.168.204.45@tcp:35:bash.0 00000100:00100000:0.0:1788651911.909004:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+59:11399:x1875537125502080:12345-192.168.204.45@tcp:35:bash.0 Request processed in 452us (601us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788651911.909013:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:3.0:1788651912.027958:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.028133:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125502208 00000100:00100000:2.0:1788651912.028145:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125502208 00000100:00080000:0.0:1788651912.028336:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651912.028392:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 119 00000100:00100000:2.0:1788651912.028404:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+59:11405:x1875537125502208:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651912.028429:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651912.028450:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4490 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d8b expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.028514:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4497 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.028543:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4497 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.028554:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4497 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651912.028601:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788651912.028605:0:12192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651912.028625:0:12192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4497 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.028732:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c4490 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d8b expref: 61 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.028750:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4497 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d8b expref: 60 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.028758:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651912.028761:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651912.028764:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dc600, rc 0) 00000100:00100000:2.0:1788651912.028884:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+60:11405:x1875537125502208:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 483us (937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.028891:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 119 00000100:00100000:1.0:1788651912.034737:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.035422:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125502336 00000100:00100000:2.0:1788651912.035433:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125502336 00000100:00100000:2.0:1788651912.035540:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 120 00000100:00100000:2.0:1788651912.035551:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+60:11405:x1875537125502336:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651912.035573:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651912.035622:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c449e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d92 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035717:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c44a5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035732:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c44a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035743:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c44a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035754:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44ac lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035761:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035766:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035849:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c44b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035859:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c44b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035866:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c44b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651912.035930:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788651912.035936:0:10110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651912.035959:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c44b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035979:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c44b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035987:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c44a5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.035994:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c44a5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036000:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c44a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036005:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651912.036009:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c44a5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036028:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c44a5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036041:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651912.036044:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651912.036048:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c44a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036055:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c44a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036067:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44ac lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036073:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44ac lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036085:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036090:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651912.036104:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44ac lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036110:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44ac lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036118:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f86d455fa00) 00010000:00010000:2.0:1788651912.036120:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651912.036123:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44ac lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036128:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44ac lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036155:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c449e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d92 expref: 62 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036168:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c44b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d92 expref: 61 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.036175:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651912.036176:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651912.036179:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dca00, rc 0) 00000100:00100000:2.0:1788651912.036258:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+61:11405:x1875537125502336:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 709us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.036275:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 120 00000100:00100000:1.0:1788651912.040503:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.040622:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651912.040726:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125502720 00000100:00100000:3.0:1788651912.040736:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125502720 00000100:00100000:3.0:1788651912.040814:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:3.0:1788651912.040826:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+61:2391:x1875537125502720:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651912.040841:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651912.040864:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c44b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d92 expref: 61 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.040885:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:3.0:1788651912.040890:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651912.040968:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+60:2391:x1875537125502720:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 145us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651912.040975:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:0.0:1788651912.045461:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125502592 00000100:00100000:0.0:1788651912.045496:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125502592 00000100:00100000:0.0:1788651912.045570:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 121 00000100:00100000:0.0:1788651912.045581:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+60:11405:x1875537125502592:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651912.045612:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651912.045634:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c44ba lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33d99 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.045740:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.045755:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d84 expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.045763:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.045810:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d84 expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.045823:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d84 expref: 61 pid: 6510 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651912.045836:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1875537147599360:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651912.045949:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788651912.050343:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651912.050873:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125502848 00000100:00100000:3.0:1788651912.050884:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125502848 00010000:00010000:3.0:1788651912.050947:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d84 expref: 62 pid: 6510 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651912.051011:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 70 00000100:00100000:3.0:1788651912.051031:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+62:2389:x1875537125502848:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651912.051046:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651912.051054:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d84 expref: 62 pid: 6510 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.051087:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d84 expref: 62 pid: 6510 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.051124:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:3.0:1788651912.051129:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.051141:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.051149:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.051170:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651912.051236:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+62:2389:x1875537125502848:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 206us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651912.051245:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 70 00010000:00010000:2.0:1788651912.051992:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4489 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d84 expref: 61 pid: 6510 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651912.052010:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1875537147599360:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651912.052044:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.052054:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.052060:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651912.052079:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788651912.052237:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c44ba lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d99 expref: 62 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.052254:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d99 expref: 61 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.052264:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651912.052267:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788651912.052270:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96600, rc 0) 00000100:00100000:2.0:1788651912.052318:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+61:11405:x1875537125502592:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 6738us (11695us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1788651912.052669:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 121 00000100:00100000:1.0:1788651912.056233:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651912.056314:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125503104 00000100:00100000:3.0:1788651912.056324:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125503104 00000100:00100000:3.0:1788651912.056386:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:3.0:1788651912.056397:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+61:11405:x1875537125503104:12345-192.168.204.45@tcp:103:lfs.0 00010000:00010000:3.0:1788651912.056413:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651912.056437:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4412 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d68 expref: 61 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.056455:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:3.0:1788651912.056460:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651912.056534:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+60:11405:x1875537125503104:12345-192.168.204.45@tcp:103:lfs.0 Request processed in 138us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651912.056542:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:3.0:1788651912.059036:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.059172:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125503232 00000100:00100000:2.0:1788651912.059181:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125503232 00000100:00100000:2.0:1788651912.059242:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 122 00000100:00100000:2.0:1788651912.059251:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+60:11405:x1875537125503232:12345-192.168.204.45@tcp:58:lfs.0 00010000:00010000:2.0:1788651912.059358:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.059377:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.059390:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788651912.059493:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788651912.059578:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+60:11405:x1875537125503232:12345-192.168.204.45@tcp:58:lfs.0 Request processed in 328us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.059585:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 122 00000100:00100000:1.0:1788651912.062616:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.062720:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125503360 00000100:00100000:2.0:1788651912.062731:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125503360 00000100:00100000:2.0:1788651912.062803:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 123 00000100:00100000:2.0:1788651912.062813:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+60:11405:x1875537125503360:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651912.062838:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651912.062859:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c44d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33da0 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.062943:0:12192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.062954:0:12192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c44d6 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33da0 expref: 61 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.062989:0:12192:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.063001:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c44d6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33da0 expref: 61 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.063025:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651912.063028:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651912.063032:0:12192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c44d6 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33da0 expref: 61 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.063039:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dda00, rc 0) 00000100:00100000:2.0:1788651912.063104:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+61:11405:x1875537125503360:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 284us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.063111:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 123 00000100:00100000:0.0:1788651912.161595:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651912.161619:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147599488:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651912.161686:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651912.162043:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147599488 00000100:00100000:1.0:1788651912.162051:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147599488 00000100:00100000:1.0:1788651912.162109:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788651912.162118:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147599488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651912.162152:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788651912.162215:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147599488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.162222:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788651912.162265:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147599488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788651912.357281:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.357341:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.357386:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.357424:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.357440:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.357466:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.357494:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125503872 00000100:00100000:1.0:1788651912.357503:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125503872 00000100:00100000:1.0:1788651912.357567:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125503744 00000100:00100000:1.0:1788651912.357571:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125503744 00000100:00100000:1.0:1788651912.357598:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 113 00000100:00100000:1.0:1788651912.357608:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125503872:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651912.357679:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125503872:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 73us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.357687:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 113 00000100:00100000:1.0:1788651912.357704:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 114 00000100:00100000:1.0:1788651912.357711:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125503744:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651912.357735:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125503744:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 25us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.357740:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 114 00000100:00100000:2.0:1788651912.357931:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125503488 00000100:00100000:2.0:1788651912.357935:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125503488 00000100:00100000:2.0:1788651912.357971:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 386 00000100:00100000:2.0:1788651912.357978:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125503488:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651912.358008:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125503488:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 31us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.358014:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 386 00000100:00100000:2.0:1788651912.358047:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125503616 00000100:00100000:2.0:1788651912.358050:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125503616 00000100:00100000:2.0:1788651912.358076:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125504128 00000100:00100000:2.0:1788651912.358078:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125504128 00000100:00100000:2.0:1788651912.358107:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125504000 00000100:00100000:2.0:1788651912.358110:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125504000 00000100:00100000:2.0:1788651912.358126:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 299 00000100:00100000:2.0:1788651912.358132:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125503616:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651912.358160:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125503616:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 28us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.358167:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 299 00000100:00100000:2.0:1788651912.358180:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 300 00000100:00100000:2.0:1788651912.358186:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125504128:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651912.358208:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125504128:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 22us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.358213:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 300 00000100:00100000:2.0:1788651912.358225:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 301 00000100:00100000:2.0:1788651912.358231:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125504000:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651912.358252:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125504000:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 21us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.358257:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 301 00000100:00080000:0.0:1788651912.358394:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651912.358404:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651912.358406:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1788651912.608157:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651912.608166:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651912.608210:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1788651912.608220:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788651912.608363:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147599616:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788651912.608465:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3926240 going to sleep for 11 seconds 00000100:00100000:1.0:1788651912.623134:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.623782:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125504256 00000100:00100000:2.0:1788651912.623793:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125504256 00000100:00100000:2.0:1788651912.623861:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 124 00000100:00100000:2.0:1788651912.623873:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+62:11406:x1875537125504256:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788651912.623960:0:6510:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788651912.624092:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+62:11406:x1875537125504256:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 215us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.624100:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 124 00000100:00100000:3.0:1788651912.628983:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0df80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147599616:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788651912.630175:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651912.630741:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125504384 00000100:00100000:0.0:1788651912.630750:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125504384 00000100:00100000:0.0:1788651912.630819:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 125 00000100:00100000:0.0:1788651912.630827:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+61:11406:x1875537125504384:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788651912.630894:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c44dd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.630925:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c44dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.630939:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c44dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.630954:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c44e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.630961:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c44e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.630967:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c44e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.630986:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c44eb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.630994:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c44eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631000:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c44eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651912.631068:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788651912.631072:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788651912.631096:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c44eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631106:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c44dd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631112:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c44dd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631118:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c44dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631124:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651912.631127:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c44dd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631134:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c44dd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631145:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:0.0:1788651912.631148:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651912.631153:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c44dd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631158:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c44dd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631169:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c44e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631197:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c44e4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631205:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c44e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631209:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651912.631212:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c44e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631217:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c44e4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631225:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff8f85c3352900) 00010000:00010000:0.0:1788651912.631227:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651912.631230:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c44e4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631235:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c44e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631250:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c44eb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631255:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c44eb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631260:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c44eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631265:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651912.631273:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c44eb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631279:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c44eb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631285:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:0.0:1788651912.631288:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651912.631290:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c44eb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.631295:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c44eb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651912.631382:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+61:11406:x1875537125504384:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 Request processed in 555us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651912.631390:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 125 00000100:00100000:0.0:1788651912.642049:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651912.642147:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125504640 00000100:00100000:3.0:1788651912.642158:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125504640 00000100:00100000:3.0:1788651912.642228:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 126 00000100:00100000:3.0:1788651912.642238:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+61:11406:x1875537125504640:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651912.642259:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651912.642279:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c44f2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33da7 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.642978:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.642995:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.643007:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651912.643023:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788651912.643111:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.643119:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44f9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.643125:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.643131:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651912.643135:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.643144:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44f9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.643156:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651912.643158:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788651912.643163:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44f9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.643169:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c44f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.643246:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c44f2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33da7 expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.643256:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:2.0:1788651912.643258:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651912.643262:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c44f2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33da7 expref: 63 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.643271:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907200, rc 0) 00000100:00100000:2.0:1788651912.643677:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+62:11406:x1875537125504640:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 1438us (1635us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1788651912.643686:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 126 00000100:00100000:0.0:1788651912.648241:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.648737:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125504768 00000100:00100000:2.0:1788651912.648748:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125504768 00000100:00100000:2.0:1788651912.648816:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 127 00000100:00100000:2.0:1788651912.648826:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+62:11406:x1875537125504768:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788651912.648861:0:12192:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788651912.649050:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+62:11406:x1875537125504768:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 221us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.649061:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 127 00000100:00100000:1.0:1788651912.653594:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.654217:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125505024 00000100:00100000:2.0:1788651912.654228:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125505024 00000100:00100000:2.0:1788651912.654282:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 128 00000100:00100000:2.0:1788651912.654291:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+62:11406:x1875537125505024:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651912.654323:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651912.654337:0:10110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788651912.654372:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc600/0xcd2f56ea038c4497 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d8b expref: 62 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.654392:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651912.654397:0:10110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651912.654412:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c4507 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33dae expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788651912.655856:0:10110:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788651912.656951:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c450e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.656968:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c450e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.656981:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c450e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.657057:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd400/0xcd2f56ea038c4507 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dae expref: 64 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.657076:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c450e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dae expref: 63 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.657543:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f86d455fe00) 00010000:00010000:2.0:1788651912.657546:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651912.657550:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c23dca00, rc 0) 00000100:00100000:2.0:1788651912.657627:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+63:11406:x1875537125505024:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 3335us (4050us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1788651912.657654:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 128 00000100:00100000:3.0:1788651912.663060:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.663269:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125505280 00000100:00100000:2.0:1788651912.663279:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125505280 00000100:00100000:2.0:1788651912.663343:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 129 00000100:00100000:2.0:1788651912.663364:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+63:11406:x1875537125505280:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788651912.663421:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651912.663447:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dca00/0xcd2f56ea038c450e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dae expref: 63 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663476:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f86d455fe00) 00010000:00010000:2.0:1788651912.663488:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651912.663509:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c451c lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663521:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c451c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663529:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c451c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663622:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4523 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x96123f12 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663631:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4523 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x96123f12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663638:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4523 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x96123f12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663695:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c451c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663703:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c451c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663710:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c451c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663717:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651912.663721:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c451c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663729:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c451c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663738:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651912.663741:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651912.663745:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c451c lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663751:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd800/0xcd2f56ea038c451c lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663761:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4523 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x96123f12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663778:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4523 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x96123f12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663785:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4523 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x96123f12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663796:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651912.663799:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4523 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x96123f12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663806:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4523 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x96123f12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663815:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x96123f12 (ffff8f86d455fb00) 00010000:00010000:2.0:1788651912.663817:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651912.663820:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4523 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x96123f12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.663826:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4523 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x96123f12 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651912.663940:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+62:11406:x1875537125505280:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 553us (855us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788651912.663948:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 129 00000100:00100000:0.0:1788651912.669676:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.669781:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125505408 00000100:00100000:1.0:1788651912.669790:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125505408 00000100:00100000:1.0:1788651912.669845:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 130 00000100:00100000:1.0:1788651912.669855:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+62:11406:x1875537125505408:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651912.669894:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651912.669959:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c452a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33db5 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.669996:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4531 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.670009:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4531 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.670019:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4531 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.670132:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c452a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33db5 expref: 64 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.670152:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4531 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33db5 expref: 63 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.670161:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:1.0:1788651912.670163:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788651912.670167:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1503000, rc 0) 00000100:00100000:1.0:1788651912.670229:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+63:11406:x1875537125505408:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 375us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.670235:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 130 00010000:00010000:0.0:1788651912.672169:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651912.678523:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.679000:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125505664 00000100:00100000:2.0:1788651912.679011:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125505664 00000100:00100000:2.0:1788651912.679119:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 131 00000100:00100000:2.0:1788651912.679129:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+63:11406:x1875537125505664:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788651912.679225:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.679242:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.679253:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788651912.679682:0:10110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788651912.679693:0:10110:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368614784463ns, next at 369614781349ns, rc = 0 00000004:00010000:2.0:1788651912.679740:0:10110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001512942c reply state 00000000d1896054 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.679755:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.679761:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:2.0:1788651912.679764:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788651912.679779:0:10110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651912.679889:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+65:11406:x1875537125505664:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 759us (1375us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788651912.679896:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 131 00000100:00100000:3.0:1788651912.682843:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651912.682973:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125505792 00000100:00100000:0.0:1788651912.682983:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125505792 00000100:00100000:0.0:1788651912.683077:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 132 00000100:00100000:0.0:1788651912.683145:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+65:11406:x1875537125505792:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651912.683171:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651912.683374:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c453f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33dbc expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.683438:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c453f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dbc expref: 66 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.683533:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c453f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dbc expref: 66 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.683554:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:0.0:1788651912.683557:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788651912.683560:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97000, rc 0) 00000100:00100000:0.0:1788651912.683689:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:11406:x1875537125505792:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 601us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651912.683696:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 132 00000100:00100000:3.0:1788651912.686146:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.686269:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125505920 00000100:00100000:2.0:1788651912.686278:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125505920 00000100:00100000:2.0:1788651912.686344:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 45 00000100:00100000:2.0:1788651912.686355:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2391:x1875537125505920:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788651912.686575:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2391:x1875537125505920:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 221us (437us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788651912.686595:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 45 00000100:00100000:3.0:1788651912.689625:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.689760:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125506176 00000100:00100000:2.0:1788651912.689781:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125506176 00000100:00100000:2.0:1788651912.689840:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 30 00000100:00100000:2.0:1788651912.689850:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:11406:x1875537125506176:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788651912.690056:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+67:11406:x1875537125506176:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 207us (444us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788651912.690075:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 30 00000100:00100000:3.0:1788651912.693423:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651912.693787:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125506432 00000100:00100000:3.0:1788651912.693797:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125506432 00000100:00100000:3.0:1788651912.693856:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 133 00000100:00100000:3.0:1788651912.693883:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+67:11406:x1875537125506432:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788651912.694379:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+67:11406:x1875537125506432:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 498us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651912.694387:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 133 00000100:00100000:2.0:1788651912.702508:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651912.706986:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125506560 00000100:00100000:0.0:1788651912.707008:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125506560 00000100:00100000:0.0:1788651912.707132:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 134 00000100:00100000:0.0:1788651912.707144:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+67:11406:x1875537125506560:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651912.707169:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651912.707192:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4546 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33dc3 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.707263:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c454d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.707276:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c454d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.707287:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c454d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651912.707342:0:10110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788651912.707397:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c454d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.707425:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4546 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dc3 expref: 69 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.707442:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c454d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dc3 expref: 68 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.707451:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:0.0:1788651912.707454:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788651912.707458:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97200, rc 0) 00000100:00100000:0.0:1788651912.707530:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+68:11406:x1875537125506560:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 388us (5029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651912.707536:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 134 00000100:00100000:3.0:1788651912.711066:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.711254:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125506688 00000100:00100000:2.0:1788651912.711265:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125506688 00000100:00100000:2.0:1788651912.711312:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:2.0:1788651912.711322:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2388:x1875537125506688:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651912.711362:0:8744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651912.711388:0:8744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4554 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33dca expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651912.711416:0:8744:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ca988, blocks: 0x0 00010000:00010000:2.0:1788651912.711436:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=368s v=(0 0) 00010000:00010000:2.0:1788651912.711441:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651912.711450:0:8744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4554 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dca expref: 10 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.711468:0:8744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4554 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dca expref: 10 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.711482:0:8744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6000, rc 0) 00000100:00100000:2.0:1788651912.711533:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:2388:x1875537125506688:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 211us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.711540:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:3.0:1788651912.715459:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.719020:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125506944 00000100:00100000:1.0:1788651912.719035:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125506944 00000100:00100000:1.0:1788651912.721249:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 135 00000100:00100000:1.0:1788651912.721291:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+68:11406:x1875537125506944:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788651912.721777:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+68:11406:x1875537125506944:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 486us (6318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.721786:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 135 00000100:00100000:2.0:1788651912.729284:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.729722:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125507072 00000100:00100000:1.0:1788651912.729733:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125507072 00000100:00100000:1.0:1788651912.729835:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:1.0:1788651912.729847:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:11406:x1875537125507072:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651912.729865:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651912.729887:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33dd1 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.729947:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4554 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dca expref: 11 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.729957:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651912.729961:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651912.729967:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.730001:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4554 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dca expref: 11 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.730015:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4554 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dca expref: 11 pid: 8744 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651912.730053:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c23ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875537147599744:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651912.730150:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcd15900 going to sleep for 11 seconds 00000100:00100000:1.0:1788651912.737889:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.738044:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c23ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875537147599744:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651912.738569:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.738709:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502a00, rc 0) 00000100:00100000:3.0:1788651912.738821:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125507200 00000100:00100000:3.0:1788651912.738829:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125507200 00010000:00010000:3.0:1788651912.738866:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4554 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dca expref: 12 pid: 8744 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651912.738934:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+12:11406:x1875537125507072:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 9087us (9658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651912.738944:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:3.0:1788651912.740303:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 71 00000100:00100000:3.0:1788651912.740320:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:2389:x1875537125507200:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651912.740495:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651912.740523:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4554 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dca expref: 11 pid: 8744 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.740542:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4554 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dca expref: 11 pid: 8744 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.740565:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4554 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dca expref: 11 pid: 8744 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.740593:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651912.740599:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651912.740690:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.740700:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.740741:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 10 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651912.740755:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1875537147599872:192.168.204.45@tcp:105: 00000100:00100000:3.0:1788651912.740895:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3926240 going to sleep for 11 seconds 00000100:00100000:3.0:1788651912.744803:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6496:1875537147599872:192.168.204.45@tcp:105: 00010000:00010000:3.0:1788651912.744828:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651912.744945:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:2389:x1875537125507200:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 4629us (7065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651912.744955:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 71 00000100:00100000:3.0:1788651912.749712:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.749791:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125507328 00000100:00100000:1.0:1788651912.749803:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125507328 00002000:00100000:1.0:1788651912.749856:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8f86c4e0f100 x1875537125507328/t0(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:298/0 lens 504/0 e 0 to 0 dl 1788651923 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788651912.749866:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86c4e0f100 with x1875537125507328 ext(0->12) 00002000:00010000:1.0:1788651912.749872:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f86c4e0f100 00000100:00100000:1.0:1788651912.749927:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:1.0:1788651912.749938:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:2388:x1875537125507328:12345-192.168.204.45@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788651912.751563:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+12:2388:x1875537125507328:12345-192.168.204.45@tcp:4:lhsmtool_posix.0 Request processed in 1618us (1957us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788651912.752711:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 2 00002000:00100000:1.0:1788651912.752729:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff8f86c4e0f100 x1875537125507328/t4294967309(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:298/0 lens 504/448 e 0 to 0 dl 1788651923 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788651912.752740:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86c4e0f100 with x1875537125507328 ext(0->12) 00002000:00010000:1.0:1788651912.752746:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f86c4e0f100 00000100:00100000:3.0:1788651912.754136:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651912.754240:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125507456 00000100:00100000:0.0:1788651912.754251:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125507456 00000100:00100000:0.0:1788651912.754307:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 136 00000100:00100000:0.0:1788651912.754317:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+68:11406:x1875537125507456:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788651912.757000:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:2.0:1788651912.757013:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788651912.757058:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788651912.757086:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f86fb18b600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788651912.757092:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c2e26100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f86d045f000 00000020:00080000:2.0:1788651912.757095:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c2e26f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f85c3465c00 00000004:00080000:2.0:1788651912.757119:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788651912.757140:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f86d85ee600 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788651912.757144:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c2e26e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f86d85eee40 00000020:00080000:2.0:1788651912.757147:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c2e26b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f85c3600c00 00000100:00100000:3.0:1788651912.757437:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c3391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147600128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788651912.757505:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651912.757545:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651912.757550:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147600000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788651912.757582:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651912.757625:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147600128 00000100:00100000:3.0:1788651912.757632:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147600128 00000100:00100000:3.0:1788651912.757680:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147600000 00000100:00100000:3.0:1788651912.757694:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147600000 00000100:00100000:3.0:1788651912.757716:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788651912.757724:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147600128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788651912.757854:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788651912.757858:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788651912 00002000:00010000:3.0:1788651912.757861:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788651912.757863:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788651912 -> 1788651912 00002000:00010000:3.0:1788651912.757865:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788651912.757902:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3392d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3636:x1875537147600128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (396us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788651912.757938:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788651912.757954:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788651912.757961:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147600000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788651912.757977:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:3.0:1788651912.757995:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.758015:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c4316 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d29 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.758024:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788651912.758029:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651912.758034:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.758062:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c4316 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d29 expref: 11 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.758104:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c4316 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d29 expref: 11 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651912.758116:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875537147600256:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651912.758175:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3926240 going to sleep for 11 seconds 00000004:00080000:3.0:1788651912.758215:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f86c3391880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788651912.758221:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c3391880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147600128:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788651912.759322:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759344:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759358:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759377:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651912.759383:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759391:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759407:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff8f86c3a44200) 00010000:00010000:0.0:1788651912.759410:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651912.759414:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759420:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4260 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759447:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759453:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759458:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759463:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651912.759466:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759471:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759489:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff8f86d455fc00) 00010000:00010000:0.0:1788651912.759491:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651912.759494:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759500:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c4308 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759515:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759521:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759526:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759530:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dde00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651912.759533:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759539:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759546:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f86d455fa00) 00010000:00010000:0.0:1788651912.759548:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651912.759551:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759556:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dde00/0xcd2f56ea038c4386 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759591:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759598:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759612:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759618:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651912.759621:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759626:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759634:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f86d455fa00) 00010000:00010000:0.0:1788651912.759637:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651912.759640:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759646:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd600/0xcd2f56ea038c43a9 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759661:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759667:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759672:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759685:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dd000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651912.759688:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759694:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759703:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:0.0:1788651912.759706:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651912.759709:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759715:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd000/0xcd2f56ea038c447b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759728:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759734:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759740:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759744:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651912.759747:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759753:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759792:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:0.0:1788651912.759794:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788651912.759797:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.759804:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4538 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788651912.759824:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788651912.759882:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00080000:0.0:1788651912.759892:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651912.760072:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11406:x1875537125507456:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 Request processed in 5753us (5938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651912.760092:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 136 00000100:00100000:1.0:1788651912.760816:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651912.760832:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147600384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788651912.760888:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651912.760955:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147600384 00000100:00100000:1.0:1788651912.760972:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147600384 00000100:00100000:1.0:1788651912.761013:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788651912.761020:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcefe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3638:x1875537147600384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788651912.761045:0:8744:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1788651912.761076:0:8744:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ca986, atime: 0x6a9ca987, ctime: 0x6a9ca986, blocks: 0x8 00010000:00010000:1.0:1788651912.761096:0:8744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061ed5ee4/0xcd2f56ea038c4569 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.761110:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1788651912.761114:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651912.761120:0:8744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061ed5ee4/0xcd2f56ea038c4569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.761135:0:8744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061ed5ee4/0xcd2f56ea038c4569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.761145:0:8744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061ed5ee4/0xcd2f56ea038c4569 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.761152:0:8744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061ed5ee4/0xcd2f56ea038c4569 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.761169:0:8744:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788651912.761294:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcefe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3638:x1875537147600384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 273us (405us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788651912.761302:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:1.0:1788651912.761687:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f86d109b100/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788651912.761702:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147600384:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788651912.761724:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651912.761730:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061ed5ee4/0xcd2f56ea038c4569 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.761739:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651912.761743:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061ed5ee4/0xcd2f56ea038c4569 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.761751:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061ed5ee4/0xcd2f56ea038c4569 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.761777:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061ed5ee4/0xcd2f56ea038c4569 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.761785:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061ed5ee4/0xcd2f56ea038c4569 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.761802:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651912.761804:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651912.761806:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651912.766174:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651912.766272:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125507584 00000100:00100000:0.0:1788651912.766283:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125507584 00000100:00100000:0.0:1788651912.766345:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 51 00000100:00100000:0.0:1788651912.766468:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+12:2389:x1875537125507584:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788651912.768318:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788651912.768329:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1788651912.770680:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.770716:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125507712 00000100:00100000:1.0:1788651912.770726:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125507712 00010000:00010000:1.0:1788651912.770775:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c4316 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d29 expref: 8 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651912.770825:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 72 00000100:00100000:1.0:1788651912.770851:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125507712:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651912.770868:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651912.770875:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c4316 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d29 expref: 8 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.770888:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c4316 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d29 expref: 8 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.770940:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651912.770945:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651912.770951:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.770961:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.770981:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651912.771039:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125507712:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 190us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.771047:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 72 00010000:00010000:3.0:1788651912.772787:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050cbfecc/0xcd2f56ea038c4316 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d29 expref: 7 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651912.772808:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875537147600256:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651912.772832:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.772843:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.772851:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.772863:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.772890:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.772947:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788651912.773042:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651912.773049:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.773056:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651912.773061:0:7452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.773075:0:7452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.773101:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.773108:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2287eb7/0xcd2f56ea038c4562 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.773126:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651912.773128:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651912.773130:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651912.774560:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3391500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875537147600000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16594us (16983us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788651912.774571:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788651912.774991:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125507584:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 Request processed in 8636us (8827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651912.774999:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 51 00000100:00100000:2.0:1788651912.778532:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788651912.778544:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1788651912.778566:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f86c3391880, transno 4294967310 00000100:00100000:2.0:1788651912.778893:0:3636:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8f86c4e0dc00 x1875537147600000/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788651928 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788651912.778923:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f86c4e0dc00/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788651912.779051:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651912.779263:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125507968 00000100:00100000:0.0:1788651912.779271:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125507968 00000100:00100000:0.0:1788651912.779336:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 137 00000100:00100000:0.0:1788651912.779346:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11406:x1875537125507968:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788651912.779411:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651912.779450:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c454d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dc3 expref: 16 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.779467:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:0.0:1788651912.779473:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651912.779501:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.779514:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.779524:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788651912.779870:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000041f86dda reply state 0000000011c856d1 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.779884:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.779891:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:0.0:1788651912.779894:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788651912.779897:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788651912.780041:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:11406:x1875537125507968:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 695us (990us total) trans 4294967403 rc 0/0 00000100:00100000:0.0:1788651912.780049:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 137 00000100:00100000:2.0:1788651912.781199:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147600000:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788651912.783534:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.783760:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125508096 00000100:00100000:1.0:1788651912.783781:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125508096 00000100:00100000:1.0:1788651912.783840:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 52 00000100:00100000:1.0:1788651912.783850:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125508096:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788651912.784037:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788651912.784042:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788651912 -> 1788651911 00002000:00010000:1.0:1788651912.784044:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788651911 00002000:00010000:1.0:1788651912.784046:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788651912 -> 1788651911 00002000:00010000:1.0:1788651912.784049:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:1.0:1788651912.784117:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125508096:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 268us (592us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788651912.784124:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 52 00000100:00100000:3.0:1788651912.786309:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.786490:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125508352 00000100:00100000:2.0:1788651912.786499:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125508352 00000100:00100000:2.0:1788651912.786564:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 138 00000100:00100000:2.0:1788651912.786583:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:11406:x1875537125508352:12345-192.168.204.45@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788651912.786657:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.786674:0:12192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4531 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33db5 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.786683:0:12192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.786719:0:12192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4531 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33db5 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.786733:0:12192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4531 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33db5 expref: 17 pid: 6509 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651912.786747:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147600512:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651912.786831:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac80c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651912.791108:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.791310:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125508480 00000100:00100000:1.0:1788651912.791320:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125508480 00010000:00010000:1.0:1788651912.791495:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4531 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33db5 expref: 18 pid: 6509 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651912.791543:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 73 00000100:00100000:1.0:1788651912.791554:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:2389:x1875537125508480:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651912.791569:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651912.791588:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4531 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33db5 expref: 18 pid: 6509 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.791602:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4531 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33db5 expref: 18 pid: 6509 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.791686:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:1.0:1788651912.791692:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.791702:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.791711:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.791733:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651912.791797:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:2389:x1875537125508480:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 246us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.791805:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 73 00010000:00010000:3.0:1788651912.793109:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c4531 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33db5 expref: 17 pid: 6509 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651912.793132:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147600512:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651912.793155:0:12192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.793164:0:12192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.793170:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.793213:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.793220:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.793249:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.793255:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651912.793260:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.793268:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.793282:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:3.0:1788651912.793286:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788651912.793290:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.793296:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4577 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651912.793757:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11406:x1875537125508352:12345-192.168.204.45@tcp:55:lhsmtool_posix.0 Request processed in 7182us (7453us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788651912.793778:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 138 00000100:00100000:2.0:1788651912.796746:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651912.796876:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125508608 00000100:00100000:3.0:1788651912.796887:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125508608 00000100:00100000:0.0:1788651912.797184:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:0.0:1788651912.797197:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2391:x1875537125508608:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788651912.797247:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.797285:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.797295:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651912.797299:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651912.797304:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.797470:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.797486:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 7 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651912.797500:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875537147600640:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651912.797981:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651912.800960:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8428:1875537147600640:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651912.800989:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651912.802888:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.803160:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125508736 00000100:00100000:1.0:1788651912.803182:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125508736 00010000:00010000:1.0:1788651912.803219:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 8 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651912.803260:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 74 00000100:00100000:1.0:1788651912.803269:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125508736:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651912.803285:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651912.803306:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 8 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.803320:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 8 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.803344:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046ea56b3/0xcd2f56ea038c455b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd1 expref: 8 pid: 8428 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.803362:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651912.803366:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651912.803372:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.803382:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.803412:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651912.803461:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125508736:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 193us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.803478:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 74 00010000:00010000:2.0:1788651912.803885:0:8428:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.803895:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.803964:0:8428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.803973:0:8428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.803981:0:8428:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.803988:0:8428:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788651912.803992:0:8428:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.804001:0:8428:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.804014:0:8428:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.804022:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eed1c623/0xcd2f56ea038c457e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651912.804096:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2391:x1875537125508608:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 Request processed in 6901us (7359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651912.804104:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:2.0:1788651912.807655:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651912.807788:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125508992 00000100:00100000:0.0:1788651912.807798:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125508992 00000100:00100000:0.0:1788651912.807855:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 139 00000100:00100000:0.0:1788651912.807864:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:11406:x1875537125508992:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788651912.807983:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.807999:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4474 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d7d expref: 16 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.808009:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.808056:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4474 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d7d expref: 16 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.808068:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4474 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d7d expref: 16 pid: 12192 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651912.808093:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147600768:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651912.808174:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651912.811405:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147600768:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651912.811439:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651912.812781:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.813046:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125509120 00000100:00100000:1.0:1788651912.813055:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125509120 00010000:00010000:1.0:1788651912.813101:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4474 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d7d expref: 17 pid: 12192 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651912.813138:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 75 00000100:00100000:1.0:1788651912.813147:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:2388:x1875537125509120:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651912.813175:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651912.813182:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4474 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d7d expref: 17 pid: 12192 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.813194:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4474 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d7d expref: 17 pid: 12192 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.813216:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc000/0xcd2f56ea038c4474 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d7d expref: 17 pid: 12192 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.813231:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:1.0:1788651912.813236:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c44d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33da0 expref: 16 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.813245:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.813253:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.813278:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.813298:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651912.813486:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:2388:x1875537125509120:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 338us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.813493:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 75 00010000:00010000:0.0:1788651912.813871:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.813880:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.814075:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.814107:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c453f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dbc expref: 16 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.814115:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.814142:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c453f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dbc expref: 16 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.814155:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c453f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dbc expref: 16 pid: 12192 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651912.814167:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147600896:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651912.814219:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651912.818973:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.819078:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125509248 00000100:00100000:1.0:1788651912.819088:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125509248 00000100:00100000:0.0:1788651912.819118:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147600896:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651912.819125:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c453f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dbc expref: 17 pid: 12192 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.819142:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651912.819166:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 76 00000100:00100000:1.0:1788651912.819175:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:2389:x1875537125509248:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651912.819191:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651912.819198:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c453f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dbc expref: 17 pid: 12192 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.819211:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c453f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dbc expref: 17 pid: 12192 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.819234:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c453f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dbc expref: 17 pid: 12192 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.819250:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:1.0:1788651912.819255:0:7919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.819287:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.819296:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.819326:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651912.819379:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:2389:x1875537125509248:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 205us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.819387:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 76 00010000:00010000:0.0:1788651912.819580:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.819599:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651912.819714:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788651912.819970:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788651912.820009:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788651912.820106:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6511:1875537147601024:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788651912.820170:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651912.820198:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c62806c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651912.820391:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147601024 00000100:00100000:1.0:1788651912.820398:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147601024 00000100:00100000:1.0:1788651912.820444:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788651912.820453:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6511:x1875537147601024:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788651912.820537:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6511:x1875537147601024:12345-0@lo:1000:mdt00_002.0 Request processed in 86us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.820545:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788651912.821196:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6511:1875537147601024:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788651912.821327:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:0.0:1788651912.821381:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6511:1875537147601152:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788651912.821421:0:6511:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651912.821444:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6280180 going to sleep for 11 seconds 00000100:00100000:1.0:1788651912.821992:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147601152 00000100:00100000:1.0:1788651912.821998:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147601152 00000100:00100000:1.0:1788651912.822045:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788651912.822054:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6511:x1875537147601152:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788651912.822187:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6511:x1875537147601152:12345-0@lo:1000:mdt00_002.0 Request processed in 134us (765us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788651912.822195:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788651912.822231:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6511:1875537147601152:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788651912.822272:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822281:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822289:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822295:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651912.822300:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822308:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822326:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:2.0:1788651912.822340:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651912.822346:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822359:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c458c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822386:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822392:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822417:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822422:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c23dc800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651912.822425:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822431:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822439:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651912.822442:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651912.822448:0:6511:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c44d6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33da0 expref: 19 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822459:0:6511:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c44d6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33da0 expref: 19 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822468:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c44d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33da0 expref: 19 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651912.822497:0:6511:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c44d6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33da0 expref: 19 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651912.822509:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147601280:192.168.204.45@tcp:105: 00000100:00100000:2.0:1788651912.822637:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788651912.826758:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147601280:192.168.204.45@tcp:105: 00010000:00010000:0.0:1788651912.826801:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826811:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dc800/0xcd2f56ea038c44cf lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826846:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4593 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826860:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4593 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826872:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4593 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826883:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4593 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826889:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4593 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826896:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4593 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826943:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651912.826947:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4593 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826954:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4593 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826966:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:0.0:1788651912.826969:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651912.826973:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4593 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826978:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4593 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826990:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.826996:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.827003:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.827007:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651912.827010:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.827016:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.827035:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:0.0:1788651912.827037:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788651912.827041:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651912.827047:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4585 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788651912.827329:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651912.827334:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651912.827831:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788651912.827847:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788651912.832221:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:11406:x1875537125508992:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 24344us (24560us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788651912.832238:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 139 00000020:00080000:0.0:1788651912.832247:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788651912.836159:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651912.836685:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125509376 00000100:00100000:0.0:1788651912.836696:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125509376 00000100:00100000:0.0:1788651912.836761:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:0.0:1788651912.836780:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:11405:x1875537125509376:12345-192.168.204.45@tcp:49:lfs.0 00000100:00100000:0.0:1788651912.836944:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:11405:x1875537125509376:12345-192.168.204.45@tcp:49:lfs.0 Request processed in 128us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651912.836953:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:0.0:1788651912.839270:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651912.841516:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125509632 00000100:00100000:3.0:1788651912.841536:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125509632 00000100:00100000:3.0:1788651912.841895:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 32 00000100:00100000:3.0:1788651912.841936:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:11406:x1875537125509632:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788651912.842219:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788651912.842251:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:3.0:1788651912.842286:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c459a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.842304:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c459a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.842316:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c459a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.842324:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c459a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.842342:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c459a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.842416:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c459a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.842437:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788651912.842728:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651912.842735:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c459a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.842751:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651912.842756:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c459a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.842774:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c459a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.842787:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:1.0:1788651912.842790:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788651912.842794:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c459a lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.842801:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c459a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.842813:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651912.842815:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651912.842816:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651912.843232:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6ed450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:11406:x1875537125509632:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 1324us (3967us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788651912.843241:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 32 00000020:00080000:3.0:1788651912.843247:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788651912.843501:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.843687:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125509888 00000100:00100000:1.0:1788651912.843695:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125509888 00000100:00100000:1.0:1788651912.843755:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 140 00000100:00100000:1.0:1788651912.843774:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:11405:x1875537125509888:12345-192.168.204.45@tcp:58:lfs.0 00000040:00080000:1.0:1788651912.843936:0:10110:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788651912.843987:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:11405:x1875537125509888:12345-192.168.204.45@tcp:58:lfs.0 Request processed in 223us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.843994:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 140 00000100:00100000:1.0:1788651912.880162:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651912.880294:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125510016 00000100:00100000:3.0:1788651912.880305:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125510016 00000100:00100000:3.0:1788651912.880373:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 141 00000100:00100000:3.0:1788651912.880383:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:11408:x1875537125510016:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651912.880406:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651912.880441:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907e00/0xcd2f56ea038c45a1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33dd8 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.880506:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45a8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.880520:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.880533:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.880546:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.880553:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.880560:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.880644:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.880656:0:12192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d99 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.880664:0:12192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.880699:0:12192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d99 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.880725:0:12192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d99 expref: 22 pid: 6510 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651912.880740:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3588e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147601408:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651912.880849:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3926f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788651912.883818:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651912.883887:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125510272 00000100:00100000:2.0:1788651912.883931:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125510272 00000100:00100000:3.0:1788651912.883941:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3588e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147601408:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651912.883967:0:12192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651912.883979:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:2.0:1788651912.883988:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:10779:x1875537125510272:12345-192.168.204.45@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788651912.884212:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:10779:x1875537125510272:12345-192.168.204.45@tcp:35:ldlm_bl.0 Request processed in 223us (402us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788651912.884220:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:2.0:1788651912.887185:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651912.887347:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125510400 00000100:00100000:1.0:1788651912.887358:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125510400 00010000:00010000:1.0:1788651912.887395:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d99 expref: 24 pid: 6510 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651912.887439:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 77 00000100:00100000:1.0:1788651912.887450:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:2388:x1875537125510400:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651912.887466:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651912.887473:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d99 expref: 24 pid: 6510 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.887487:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d99 expref: 24 pid: 6510 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.887509:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96600/0xcd2f56ea038c44c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d99 expref: 24 pid: 6510 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.887529:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:1.0:1788651912.887534:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.887544:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.887553:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651912.887627:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651912.887692:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:2388:x1875537125510400:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 244us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651912.887700:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 77 00010000:00010000:3.0:1788651912.887832:0:12192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.887841:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651912.887897:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788651912.887902:0:12192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788651912.888786:0:12192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888805:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888816:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45a8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888824:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45a8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888847:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888853:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651912.888857:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45a8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888866:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45a8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888879:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:3.0:1788651912.888882:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651912.888887:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888893:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888952:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888959:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888965:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888970:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651912.888974:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.888991:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.889000:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff8f85c3368900) 00010000:00010000:3.0:1788651912.889002:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651912.889006:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.889021:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.889063:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907e00/0xcd2f56ea038c45a1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd8 expref: 23 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.889078:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd8 expref: 22 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651912.889085:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:3.0:1788651912.889087:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651912.889090:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906a00, rc 0) 00000100:00100000:3.0:1788651912.889143:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:11408:x1875537125510016:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 8761us (8992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651912.889151:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 141 00000100:00100000:0.0:1788651913.697796:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651913.697825:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147601536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651913.697899:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651913.698017:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147601536 00000100:00100000:0.0:1788651913.698025:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147601536 00000100:00100000:0.0:1788651913.698250:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788651913.698261:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875537147601536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651913.698298:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:3.0:1788651913.705086:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147601664:0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.705163:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651913.705210:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651913.705218:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147601792:0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.705264:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651913.705334:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147602176:0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.705359:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651913.705401:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147602304:0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.705427:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651913.705461:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147602304 00000100:00100000:3.0:1788651913.705469:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147602304 00000100:00100000:3.0:1788651913.705515:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788651913.705525:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147602304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.705597:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147602304:12345-0@lo:400:kworker.0 Request processed in 66us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651913.705604:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788651913.705643:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147602304:0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.705690:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147602688:0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.705712:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651913.705774:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147602816:0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.705796:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651913.705822:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147602688 00000100:00100000:3.0:1788651913.705825:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147602688 00000100:00100000:3.0:1788651913.705858:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147602816 00000100:00100000:3.0:1788651913.705861:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147602816 00000100:00100000:3.0:1788651913.705877:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788651913.705883:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147602688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.705935:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147602688:12345-0@lo:400:kworker.0 Request processed in 52us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651913.705942:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788651913.705962:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788651913.705967:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147602816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.705998:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147602816:12345-0@lo:400:kworker.0 Request processed in 31us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651913.706005:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788651913.706030:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147602688:0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.706053:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147602816:0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.706094:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147603200:0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.706119:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651913.706143:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147603200 00000100:00100000:3.0:1788651913.706146:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147603200 00000100:00100000:3.0:1788651913.706166:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788651913.706171:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147603200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.706204:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147603200:12345-0@lo:400:kworker.0 Request processed in 32us (84us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651913.706210:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788651913.706234:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147603200:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.706679:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875537147601536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8417us (8777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651913.706690:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788651913.706725:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c358b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147601920:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.706769:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651913.706794:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147602432:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.706818:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651913.706837:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147602944:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.706859:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651913.706897:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147601536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651913.706930:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788651913.706938:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147602048:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788651913.706963:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651913.706986:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147602560:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.707010:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651913.707028:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147603072:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.707053:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651913.707116:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147602048 00000100:00100000:0.0:1788651913.707123:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147602048 00000100:00100000:0.0:1788651913.707152:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788651913.707159:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147602048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788651913.707176:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:0.0:1788651913.707217:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147602048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651913.707232:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788651913.707256:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147601664 00000100:00100000:0.0:1788651913.707261:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147601664 00000100:00100000:0.0:1788651913.707289:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:0.0:1788651913.707296:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147601664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651913.707386:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147601920 00000100:00100000:3.0:1788651913.707391:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147601920 00000100:00100000:3.0:1788651913.707422:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788651913.707431:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147601920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.707453:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147601664:12345-0@lo:400:kworker.0 Request processed in 155us (2288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651913.707461:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1788651913.707478:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147601920:12345-0@lo:400:kworker.0 Request processed in 47us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651913.707488:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788651913.707501:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147601792 00000100:00100000:0.0:1788651913.707507:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147601792 00000100:00100000:0.0:1788651913.707532:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147602176 00000100:00100000:0.0:1788651913.707535:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147602176 00000100:00100000:0.0:1788651913.707560:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147602432 00000100:00100000:0.0:1788651913.707563:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147602432 00000100:00100000:0.0:1788651913.707578:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147602944 00000100:00100000:0.0:1788651913.707581:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147602944 00000100:00100000:0.0:1788651913.707593:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147602560 00000100:00100000:0.0:1788651913.707595:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147602560 00000100:00100000:0.0:1788651913.707612:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147603072 00000100:00100000:0.0:1788651913.707614:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147603072 00000100:00100000:0.0:1788651913.707627:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788651913.707633:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147601792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.707663:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147601792:12345-0@lo:400:kworker.0 Request processed in 30us (2398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651913.707669:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788651913.707680:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788651913.707686:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147602176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.707717:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147602176:12345-0@lo:400:kworker.0 Request processed in 32us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651913.707730:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788651913.707743:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788651913.707758:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147602432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.707788:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147602432:12345-0@lo:400:kworker.0 Request processed in 39us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651913.707792:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788651913.707802:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788651913.707808:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147602944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.707830:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147602944:12345-0@lo:400:kworker.0 Request processed in 23us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651913.707835:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788651913.707844:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788651913.707848:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147602560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.707871:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147602560:12345-0@lo:400:kworker.0 Request processed in 23us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651913.707877:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788651913.707887:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788651913.707892:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147603072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.707943:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147603072:12345-0@lo:400:kworker.0 Request processed in 51us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651913.707949:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:0.0:1788651913.707966:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651913.707970:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788651913.707972:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788651913.707975:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788651913.708010:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651913.708036:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147602176:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.708048:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3588a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147601792:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.708058:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147601664:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.708094:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147602048:0@lo:13:osp-pre-1-1.0 00010000:00080000:0.0:1788651913.708107:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff463800 x1875537147602560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651913.708118:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147602560:0@lo:400:kworker.0 00010000:00080000:0.0:1788651913.708127:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff4b8000 x1875537147603072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651913.708136:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147603072:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.708146:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c358b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147601920:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.708155:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147602432:0@lo:400:kworker.0 00000100:00100000:0.0:1788651913.708164:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147602944:0@lo:400:kworker.0 00000040:00080000:3.0:1788651913.800147:0:14306:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651913.800164:0:14306:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651913.800199:0:14306:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788651913.800207:0:14306:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788651913.892502:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788651913.892510:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788651913.892532:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788651913.892540:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788651913.893540:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147603328:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788651913.894778:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d3b63480 going to sleep for 11 seconds 00000100:00100000:3.0:1788651913.911714:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651913.911763:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125510528 00000100:00100000:3.0:1788651913.911772:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125510528 00000100:00100000:3.0:1788651913.911826:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 142 00000100:00100000:3.0:1788651913.911836:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:11421:x1875537125510528:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788651913.911877:0:6511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788651913.912014:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:11421:x1875537125510528:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 180us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651913.912022:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 142 00000100:00100000:1.0:1788651913.912578:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147603328:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788651913.923230:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651913.924162:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125510784 00000100:00100000:3.0:1788651913.924173:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125510784 00000100:00100000:3.0:1788651913.924241:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 143 00000100:00100000:3.0:1788651913.924251:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:11421:x1875537125510784:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651913.924273:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651913.924294:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907e00/0xcd2f56ea038c45bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ddf expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651913.924412:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651913.924428:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651913.924441:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651913.924472:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788651913.924899:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907e00/0xcd2f56ea038c45bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ddf expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651913.924947:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ddf expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651913.924957:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:3.0:1788651913.924960:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651913.924964:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906600, rc 0) 00000100:00100000:3.0:1788651913.925028:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:11421:x1875537125510784:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 778us (1808us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788651913.925035:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 143 00000100:00100000:3.0:1788651913.947793:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651913.947897:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651913.948000:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125511168 00000100:00100000:2.0:1788651913.948010:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125511168 00000100:00100000:2.0:1788651913.948096:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:2.0:1788651913.948107:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:2388:x1875537125511168:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651913.948122:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651913.948147:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906600/0xcd2f56ea038c45c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ddf expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651913.948164:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651913.948170:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651913.948221:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:2388:x1875537125511168:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 116us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651913.948229:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:0.0:1788651913.950223:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125511040 00000100:00100000:0.0:1788651913.950255:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125511040 00000100:00100000:0.0:1788651913.950455:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 144 00000100:00100000:0.0:1788651913.950466:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:11421:x1875537125511040:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788651913.950568:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c45d2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651913.950593:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c45d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651913.950605:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c45d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651913.950761:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c45d2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651913.950769:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c45d2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651913.950777:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c45d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651913.950783:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651913.950788:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c45d2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651913.950795:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c45d2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651913.950806:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:0.0:1788651913.950809:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788651913.950814:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c45d2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651913.950831:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c45d2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651913.950978:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:11421:x1875537125511040:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 513us (3192us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788651913.950986:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 144 00000040:00080000:2.0:1788651913.951147:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651913.951152:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651913.951658:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788651913.951666:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651913.964856:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651913.964945:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125511424 00000100:00100000:2.0:1788651913.964955:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125511424 00000100:00100000:2.0:1788651913.965016:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:2.0:1788651913.965034:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:11421:x1875537125511424:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788651913.965267:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:11421:x1875537125511424:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 234us (420us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788651913.965275:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:0.0:1788651914.720406:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147603456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788651914.720483:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651914.720745:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147603456 00000100:00100000:3.0:1788651914.720754:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147603456 00000100:00100000:3.0:1788651914.720807:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788651914.720815:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147603456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651914.720845:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651914.720890:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147603456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651914.720898:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788651914.721076:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147603456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788651914.721529:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651914.721925:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651914.721937:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147603584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651914.721981:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651914.722079:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147603584 00000100:00100000:0.0:1788651914.722085:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147603584 00000100:00100000:0.0:1788651914.722129:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788651914.722138:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147603584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788651914.722154:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651914.722197:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147603584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 60us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651914.722203:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788651914.723176:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147603584:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788651915.365683:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788651915.748796:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651915.754213:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147603712:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788651915.754309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651915.754399:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147603712 00000100:00100000:1.0:1788651915.754407:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147603712 00000100:00100000:1.0:1788651915.754460:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788651915.754469:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147603712:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651915.754506:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651915.754788:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147603712:12345-0@lo:41:osp-pre-1-0.0 Request processed in 319us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651915.754796:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788651915.754846:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147603712:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788651916.001370:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651916.001379:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651916.001404:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788651916.001413:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788651916.102493:0:14357:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651916.102510:0:14357:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651916.102997:0:14357:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788651916.103007:0:14357:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788651916.385433:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651916.385476:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125511680 00000100:00100000:3.0:1788651916.385488:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125511680 00000100:00100000:3.0:1788651916.385572:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 145 00000100:00100000:3.0:1788651916.385584:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:11441:x1875537125511680:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651916.385610:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651916.385632:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45d9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33de6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651916.385755:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907e00/0xcd2f56ea038c45e0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651916.385771:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907e00/0xcd2f56ea038c45e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651916.385785:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907e00/0xcd2f56ea038c45e0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651916.385797:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788651916.385964:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c45d9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33de6 expref: 28 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651916.385983:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907e00/0xcd2f56ea038c45e0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33de6 expref: 27 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651916.385992:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:3.0:1788651916.385995:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788651916.386008:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907e00, rc 0) 00000100:00100000:3.0:1788651916.386078:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:11441:x1875537125511680:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 496us (659us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788651916.386085:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 145 00000100:00080000:3.0:1788651916.386111:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651916.390187:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651916.390229:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125511808 00000100:00100000:0.0:1788651916.390241:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125511808 00000100:00100000:0.0:1788651916.390311:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 146 00000100:00100000:0.0:1788651916.390321:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:11441:x1875537125511808:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:0.0:1788651916.390388:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c45ee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651916.390405:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c45ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651916.390428:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c45ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651916.390467:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c45ee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651916.390474:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c45ee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651916.390480:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c45ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651916.390487:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651916.390491:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c45ee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651916.390498:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c45ee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651916.390508:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:0.0:1788651916.390512:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651916.390659:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c45ee lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651916.390668:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96000/0xcd2f56ea038c45ee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651916.390756:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:11441:x1875537125511808:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 436us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651916.390763:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 146 00000100:00100000:3.0:1788651916.527502:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651916.527668:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125511936 00000100:00100000:0.0:1788651916.527704:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125511936 00000100:00100000:0.0:1788651916.527784:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:0.0:1788651916.527796:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2391:x1875537125511936:12345-192.168.204.45@tcp:101:cat.0 00010000:00010000:0.0:1788651916.527812:0:8744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651916.527832:0:8744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000443f3c4b/0xcd2f56ea038c45f5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ded expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788651916.527860:0:8744:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ca987, atime: 0x6a9ca987, ctime: 0x6a9ca987, blocks: 0x8 00010000:00010000:0.0:1788651916.527882:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=372s v=(0 0) 00010000:00010000:0.0:1788651916.527886:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651916.527896:0:8744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000443f3c4b/0xcd2f56ea038c45f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ded expref: 7 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651916.527953:0:8744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000443f3c4b/0xcd2f56ea038c45f5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ded expref: 7 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651916.527969:0:8744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96000, rc 0) 00000100:00100000:0.0:1788651916.528024:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2391:x1875537125511936:12345-192.168.204.45@tcp:101:cat.0 Request processed in 231us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651916.528032:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00080000:2.0:1788651916.529055:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651916.539686:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651916.539948:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125512064 00000100:00100000:3.0:1788651916.539960:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125512064 00002000:00100000:3.0:1788651916.540029:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8f86ff463800 x1875537125512064/t0(0) o3->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:302/0 lens 488/0 e 0 to 0 dl 1788651927 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651916.540040:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86ff463800 with x1875537125512064 ext(0->4095) 00002000:00010000:3.0:1788651916.540046:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f86ff463800 00000100:00100000:3.0:1788651916.540078:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:3.0:1788651916.540088:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2390:x1875537125512064:12345-192.168.204.45@tcp:3:cat.0 00000100:00100000:3.0:1788651916.540268:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2390:x1875537125512064:12345-192.168.204.45@tcp:3:cat.0 Request processed in 181us (592us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788651916.540277:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 3 00002000:00100000:3.0:1788651916.540284:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff8f86ff463800 x1875537125512064/t0(0) o3->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:302/0 lens 488/4536 e 0 to 0 dl 1788651927 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651916.540292:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86ff463800 with x1875537125512064 ext(0->4095) 00002000:00010000:3.0:1788651916.540296:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f86ff463800 00010000:00010000:0.0:1788651916.768343:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788651916.770759:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1788651916.770779:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:2.0:1788651917.294239:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788651917.294264:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147603840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651917.294335:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651917.294410:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147603840 00000100:00100000:2.0:1788651917.294419:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147603840 00000100:00100000:2.0:1788651917.294468:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788651917.294477:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147603840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788651917.294753:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1788651917.294808:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147603840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 331us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651917.294815:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788651917.294868:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147603840:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651917.474749:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651917.474791:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651917.474825:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651917.474861:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651917.474881:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651917.474899:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651917.474952:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651917.474980:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125512448 00000100:00100000:2.0:1788651917.474990:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125512448 00000100:00100000:2.0:1788651917.475064:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125512960 00000100:00100000:2.0:1788651917.475068:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125512960 00000100:00100000:2.0:1788651917.475081:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125512320 00000100:00100000:2.0:1788651917.475083:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125512320 00000100:00100000:2.0:1788651917.475094:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125512832 00000100:00100000:2.0:1788651917.475097:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125512832 00000100:00100000:2.0:1788651917.475114:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 308 00000100:00100000:2.0:1788651917.475123:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125512448:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651917.475196:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125512448:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 74us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651917.475203:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 308 00000100:00100000:2.0:1788651917.475234:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 309 00000100:00100000:2.0:1788651917.475240:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125512960:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651917.475264:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125512960:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 24us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651917.475270:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 309 00000100:00100000:2.0:1788651917.475281:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 310 00000100:00100000:2.0:1788651917.475286:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:2388:x1875537125512320:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651917.475308:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:2388:x1875537125512320:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 22us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651917.475314:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 310 00000100:00100000:2.0:1788651917.475324:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 311 00000100:00100000:2.0:1788651917.475329:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125512832:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651917.475348:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125512832:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 19us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651917.475363:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 311 00000100:00100000:2.0:1788651917.475385:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125512704 00000100:00100000:2.0:1788651917.475388:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125512704 00000100:00100000:2.0:1788651917.475409:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125512576 00000100:00100000:2.0:1788651917.475412:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125512576 00000100:00100000:2.0:1788651917.475429:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 118 00000100:00100000:2.0:1788651917.475435:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125512704:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651917.475460:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125512704:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 26us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651917.475467:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 118 00000100:00100000:2.0:1788651917.475477:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 119 00000100:00100000:2.0:1788651917.475482:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125512576:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651917.475504:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125512576:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 22us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651917.475511:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 119 00000100:00080000:2.0:1788651917.475527:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651917.475531:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788651917.475533:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651917.476056:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125512192 00000100:00100000:1.0:1788651917.476062:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125512192 00000100:00100000:1.0:1788651917.476107:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 388 00000100:00100000:1.0:1788651917.476115:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125512192:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651917.476160:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125512192:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 47us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651917.476168:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 388 00010000:00010000:1.0:1788651917.800813:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788651917.805086:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788651917.805119:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f86c62806c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788651917.805126:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c5a1c000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f86c62809c0 00000020:00080000:1.0:1788651917.805129:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c5a1c600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f85c353e600 00000020:00080000:1.0:1788651917.805148:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:3.0:1788651917.805295:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651917.805308:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651917.805333:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651917.805338:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651917.805344:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651917.805352:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651917.805371:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff8f85c3374300) 00010000:00010000:3.0:1788651917.805374:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651917.805380:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651917.805386:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4570 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788651917.807459:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788651917.807552:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1788651918.816398:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147604352:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.816566:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147603968:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.816616:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651918.816673:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147604480:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.816700:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651918.816721:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147604992:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.816744:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651918.816780:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147605504:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.816811:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651918.816853:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147604992 00000100:00100000:2.0:1788651918.816860:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147604992 00000100:00100000:2.0:1788651918.816940:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147605504 00000100:00100000:2.0:1788651918.816942:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147605504 00000100:00100000:2.0:1788651918.816963:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788651918.816970:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147604992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651918.817108:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651918.817128:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147604864:0@lo:400:kworker.0 00000100:00100000:1.0:1788651918.817147:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651918.817154:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147605376:0@lo:400:kworker.0 00000100:00100000:1.0:1788651918.817167:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651918.817185:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147604096:0@lo:400:kworker.0 00000100:00100000:1.0:1788651918.817213:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651918.817226:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147604608:0@lo:400:kworker.0 00000100:00100000:1.0:1788651918.817240:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651918.817251:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147605120:0@lo:400:kworker.0 00000100:00100000:1.0:1788651918.817266:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651918.817283:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788651918.817294:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147604224:0@lo:400:kworker.0 00000100:00100000:1.0:1788651918.817319:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651918.817341:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147604736:0@lo:400:kworker.0 00000100:00100000:3.0:1788651918.817441:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147604864 00000100:00100000:3.0:1788651918.817447:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147604864 00000100:00100000:3.0:1788651918.817473:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147605376 00000100:00100000:3.0:1788651918.817476:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147605376 00000100:00100000:3.0:1788651918.817491:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788651918.817497:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147605504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651918.817704:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147603968 00000100:00100000:0.0:1788651918.817709:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147603968 00000100:00100000:0.0:1788651918.817749:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788651918.817764:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147603968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651918.823779:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651918.823834:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147605248:0@lo:400:kworker.0 00000100:00100000:1.0:1788651918.823890:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651918.823949:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147604480 00000100:00100000:1.0:1788651918.823957:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147604480 00000100:00100000:3.0:1788651918.824167:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147605504:12345-0@lo:400:kworker.0 Request processed in 6666us (7351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651918.824180:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788651918.824210:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788651918.824220:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147604864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651918.824256:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147604352 00000100:00100000:0.0:1788651918.824263:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147604352 00000100:00100000:0.0:1788651918.824294:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147604096 00000100:00100000:0.0:1788651918.824297:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147604096 00000100:00100000:3.0:1788651918.824304:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147604864:12345-0@lo:400:kworker.0 Request processed in 86us (7155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651918.824311:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147604608 00000100:00100000:3.0:1788651918.824315:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788651918.824316:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147604608 00000100:00100000:3.0:1788651918.824336:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788651918.824341:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147605120 00000100:00100000:0.0:1788651918.824345:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147605120 00000100:00100000:3.0:1788651918.824347:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147605376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651918.824362:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147604736 00000100:00100000:0.0:1788651918.824366:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147604736 00000100:00100000:0.0:1788651918.824377:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147605248 00000100:00100000:0.0:1788651918.824379:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147605248 00000100:00100000:0.0:1788651918.824393:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788651918.824400:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147604352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651918.824473:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147604224 00000100:00100000:1.0:1788651918.824477:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147604224 00000100:00100000:1.0:1788651918.824495:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788651918.824502:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147604480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651918.829290:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147604352:12345-0@lo:400:kworker.0 Request processed in 4876us (12167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651918.829308:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788651918.829351:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788651918.829365:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147604096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651918.829450:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147604096:12345-0@lo:400:kworker.0 Request processed in 91us (12236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651918.829456:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788651918.829469:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788651918.829476:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147604608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651918.829505:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147604608:12345-0@lo:400:kworker.0 Request processed in 31us (12264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651918.829510:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788651918.829538:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788651918.829545:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147605120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651918.829580:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147605120:12345-0@lo:400:kworker.0 Request processed in 35us (12312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651918.829585:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788651918.829596:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1788651918.829978:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147605376:12345-0@lo:400:kworker.0 Request processed in 5632us (12806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651918.829990:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788651918.830660:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147604992:12345-0@lo:400:kworker.0 Request processed in 13676us (13901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651918.830670:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788651918.831571:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147604736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651918.831667:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3391880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147604736:12345-0@lo:400:kworker.0 Request processed in 110us (7895us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651918.832093:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788651918.832114:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147605248:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788651918.832148:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651918.832156:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651918.832159:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3390000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147605248:12345-0@lo:400:kworker.0 Request processed in 57us (8267us total) trans 0 rc 0/0 00000100:00080000:3.0:1788651918.832161:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651918.832167:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651918.832171:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788651918.832224:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788651918.832233:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147604224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.832275:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2831880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147604224:12345-0@lo:400:kworker.0 Request processed in 45us (14956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651918.832282:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000001:00080000:3.0:1788651918.832330:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1788651918.832343:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:2.0:1788651918.832421:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788651918.832428:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1788651918.832454:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f86d109b100, transno 4294967305 00000100:00100000:3.0:1788651918.832463:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147604352:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.832470:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147604992:0@lo:400:kworker.0 00000100:00100000:3.0:1788651918.832485:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147604864:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.832494:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147605504:0@lo:400:kworker.0 00000100:00100000:3.0:1788651918.832502:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147605376:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.832858:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147605760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651918.832902:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651918.832962:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651918.832968:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147605632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651918.832991:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651918.833150:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147604224:0@lo:400:kworker.0 00010000:00080000:2.0:1788651918.833167:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3c88e00 x1875537147604736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651918.833178:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147604736:0@lo:400:kworker.0 00010000:00080000:2.0:1788651918.833191:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3c8a680 x1875537147605248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651918.833199:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147605248:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.833212:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147604096:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.833223:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147604608:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.833234:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147605120:0@lo:400:kworker.0 00000100:00100000:1.0:1788651918.833255:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147604480:12345-0@lo:400:kworker.0 Request processed in 8752us (16552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651918.833263:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788651918.833271:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147605760 00000100:00100000:2.0:1788651918.833277:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147605760 00000100:00100000:1.0:1788651918.833290:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147604480:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.833310:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147605632 00000100:00100000:2.0:1788651918.833313:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147605632 00000100:00100000:2.0:1788651918.833327:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788651918.833334:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147605760:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651918.833335:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147603968:12345-0@lo:400:kworker.0 Request processed in 15572us (16718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651918.833343:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00002000:00000024:2.0:1788651918.833360:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788651918.833382:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147603968:0@lo:400:kworker.0 00000100:00100000:2.0:1788651918.833395:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147605760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651918.833407:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788651918.833420:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788651918.833425:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147605632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651918.833437:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788651918.833464:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147605632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651918.833469:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788651918.833500:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147605632:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651918.833509:0:3638:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1788651918.833512:0:3638:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f86c4e0dc00, transno 4294967311 00000004:00080000:2.0:1788651918.833530:0:3638:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1788651918.833546:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147605760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651918.837760:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00010000:1.0:1788651918.837951:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651919.843009:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651919.843365:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147605888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651919.843435:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651919.844666:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c358b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147606016:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651919.844719:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651919.845362:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147605888 00000100:00100000:3.0:1788651919.845372:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147605888 00000100:00100000:3.0:1788651919.845423:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147606016 00000100:00100000:3.0:1788651919.845427:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147606016 00000100:00100000:3.0:1788651919.845443:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788651919.845451:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147605888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651919.845484:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651919.845537:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147605888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651919.845561:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788651919.845577:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788651919.845582:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3390380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147606016:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788651919.845593:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651919.845624:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3390380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147606016:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651919.845642:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788651919.845688:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c358b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147606016:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651919.845806:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147605888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788651920.865269:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651920.867393:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651920.867414:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147606144:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651920.867490:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651920.867551:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147606144 00000100:00100000:3.0:1788651920.867560:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147606144 00000100:00100000:3.0:1788651920.867760:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788651920.867770:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147606144:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651920.867801:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651920.867845:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147606144:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651920.867851:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788651920.867891:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff4ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147606144:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788651921.509367:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651921.509449:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125513088 00000100:00100000:3.0:1788651921.509459:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125513088 00000100:00100000:3.0:1788651921.509542:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 147 00000100:00100000:3.0:1788651921.509551:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:11086:x1875537125513088:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788651921.509684:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:11086:x1875537125513088:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 Request processed in 133us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651921.509692:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 147 00000100:00080000:2.0:1788651921.511026:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651921.517363:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651921.517487:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125513216 00000100:00100000:2.0:1788651921.517497:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125513216 00000100:00100000:2.0:1788651921.517587:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 148 00000100:00100000:2.0:1788651921.517609:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:11086:x1875537125513216:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788651921.517721:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:11086:x1875537125513216:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 Request processed in 124us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651921.517749:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 148 00000100:00080000:3.0:1788651921.518362:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651921.521066:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651921.521149:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125513472 00000100:00100000:3.0:1788651921.521159:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125513472 00000100:00100000:3.0:1788651921.521220:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 35 00000100:00100000:3.0:1788651921.521231:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:11086:x1875537125513472:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788651921.521483:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:11086:x1875537125513472:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 254us (425us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788651921.521492:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 35 00010000:00010000:1.0:1788651921.888797:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651922.092528:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651922.092612:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125513600 00000100:00100000:0.0:1788651922.092625:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125513600 00000100:00100000:0.0:1788651922.092716:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 149 00000100:00100000:0.0:1788651922.092728:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:11901:x1875537125513600:12345-192.168.204.45@tcp:101:lsof.0 00010000:00010000:0.0:1788651922.092749:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651922.092771:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c45fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33df4 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651922.092868:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651922.092881:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651922.092894:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651922.093604:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788651922.093609:0:10110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788651922.093653:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651922.093684:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c45fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33df4 expref: 7 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651922.093706:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33df4 expref: 6 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651922.093716:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:0.0:1788651922.093719:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651922.093722:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96400, rc 0) 00000100:00100000:0.0:1788651922.093805:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3392d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:11901:x1875537125513600:12345-192.168.204.45@tcp:101:lsof.0 Request processed in 1080us (1289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651922.093814:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 149 00000100:00080000:3.0:1788651922.094156:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788651922.400853:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147606272:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651922.400948:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651922.406454:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147606272 00000100:00100000:1.0:1788651922.407422:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147606272 00000100:00100000:1.0:1788651922.407607:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788651922.407621:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147606272:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788651922.407662:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788651922.407774:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147606272:12345-0@lo:41:osp-pre-0-1.0 Request processed in 157us (6826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651922.407781:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788651922.407885:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147606272:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788651922.595068:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651922.596418:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125513728 00000100:00100000:0.0:1788651922.596431:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125513728 00000100:00100000:0.0:1788651922.596513:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 390 00000100:00100000:0.0:1788651922.596524:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125513728:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651922.596662:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125513728:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 139us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651922.596670:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 390 00000100:00100000:1.0:1788651922.606749:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651922.606859:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651922.606895:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651922.606937:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651922.606966:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125513856 00000100:00100000:1.0:1788651922.606967:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651922.606978:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125513856 00000100:00100000:1.0:1788651922.606992:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125514368 00000100:00100000:1.0:1788651922.606998:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125514368 00000100:00100000:1.0:1788651922.607048:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125513984 00000100:00100000:1.0:1788651922.607052:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125513984 00000100:00100000:3.0:1788651922.607082:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125514112 00000100:00100000:3.0:1788651922.607088:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125514112 00000100:00100000:3.0:1788651922.607130:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125514240 00000100:00100000:3.0:1788651922.607134:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125514240 00000100:00100000:3.0:1788651922.607161:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 124 00000100:00100000:3.0:1788651922.607171:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125514112:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651922.607256:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125514112:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 87us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651922.607265:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 124 00000100:00100000:3.0:1788651922.607505:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 125 00000100:00100000:3.0:1788651922.607514:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125514240:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651922.607558:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125514240:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 45us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651922.607565:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 125 00000100:00080000:3.0:1788651922.607595:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651922.607599:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651922.607602:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788651922.610732:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 318 00000100:00100000:2.0:1788651922.610758:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125514368:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651922.610844:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125514368:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 98us (3947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651922.610851:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 318 00000100:00100000:2.0:1788651922.610872:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 319 00000100:00100000:2.0:1788651922.610880:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:2389:x1875537125513856:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651922.611004:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3391500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:2389:x1875537125513856:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 113us (4254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651922.611010:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 319 00000100:00100000:2.0:1788651922.611032:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 320 00000100:00100000:2.0:1788651922.611039:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125513984:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651922.611064:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125513984:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 26us (4127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651922.611069:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 320 00010000:00010000:0.0:1788651922.912121:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651923.936213:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147606528:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.936283:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.936341:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147607040:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.936379:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.936402:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147607552:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.936424:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.936450:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1788651923.936456:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147606400:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.936483:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.936502:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147606912:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.936526:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.936542:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147607424:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.936586:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.936608:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147607936:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.936629:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.936661:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147607424 00000100:00100000:2.0:1788651923.936668:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147607424 00000100:00100000:2.0:1788651923.936723:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147607936 00000100:00100000:2.0:1788651923.936727:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147607936 00000100:00100000:2.0:1788651923.936749:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788651923.936758:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147607424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.936816:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147607424:12345-0@lo:400:kworker.0 Request processed in 59us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651923.936823:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788651923.936839:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788651923.936846:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147607936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.936874:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147607936:12345-0@lo:400:kworker.0 Request processed in 29us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651923.936880:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:2.0:1788651923.936934:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651923.936938:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651923.936950:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147606784:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.936977:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.936995:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147607296:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937016:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.937032:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147607808:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937051:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.937068:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788651923.937074:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147606656:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937094:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.937109:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147607168:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937141:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.937159:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147607680:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937181:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651923.937200:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147607296 00000100:00100000:2.0:1788651923.937204:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147607296 00000100:00100000:2.0:1788651923.937230:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147607808 00000100:00100000:2.0:1788651923.937234:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147607808 00000100:00100000:2.0:1788651923.937248:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788651923.937254:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147607296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937289:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147607296:12345-0@lo:400:kworker.0 Request processed in 35us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651923.937295:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788651923.937306:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788651923.937311:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147607808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937350:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147607808:12345-0@lo:400:kworker.0 Request processed in 38us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651923.937356:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:2.0:1788651923.937372:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651923.937374:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651923.937403:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147607424:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937415:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147607936:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937446:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147607296:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937454:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147607808:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937470:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147606528 00000100:00100000:2.0:1788651923.937473:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147606528 00000100:00100000:2.0:1788651923.937493:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147607040 00000100:00100000:2.0:1788651923.937496:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147607040 00000100:00100000:2.0:1788651923.937513:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147607552 00000100:00100000:2.0:1788651923.937516:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147607552 00000100:00100000:2.0:1788651923.937529:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147606784 00000100:00100000:2.0:1788651923.937532:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147606784 00000100:00100000:2.0:1788651923.937541:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147607168 00000100:00100000:2.0:1788651923.937542:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147607168 00000100:00100000:2.0:1788651923.937566:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147607680 00000100:00100000:2.0:1788651923.937569:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147607680 00000100:00100000:2.0:1788651923.937583:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788651923.937590:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147606528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937636:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147606528:12345-0@lo:400:kworker.0 Request processed in 47us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651923.937643:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788651923.937655:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788651923.937668:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147607040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937699:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147607040:12345-0@lo:400:kworker.0 Request processed in 32us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651923.937705:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788651923.937717:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788651923.937722:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147607552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937748:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147607552:12345-0@lo:400:kworker.0 Request processed in 26us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651923.937754:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788651923.937764:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788651923.937769:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147606784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937799:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147606784:12345-0@lo:400:kworker.0 Request processed in 30us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651923.937805:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788651923.937816:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788651923.937822:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147607168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937847:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147607168:12345-0@lo:400:kworker.0 Request processed in 26us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651923.937853:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788651923.937864:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788651923.937870:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147607680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937896:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147607680:12345-0@lo:400:kworker.0 Request processed in 27us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651923.937901:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00080000:2.0:1788651923.937944:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788651923.937953:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651923.937974:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147606528:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937985:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147607040:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.937994:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147607552:0@lo:400:kworker.0 00010000:00080000:2.0:1788651923.938027:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3de1f80 x1875537147607168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651923.938038:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147607168:0@lo:400:kworker.0 00010000:00080000:2.0:1788651923.938048:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3de2d80 x1875537147607680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651923.938056:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147607680:0@lo:400:kworker.0 00000100:00100000:2.0:1788651923.938067:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147606784:0@lo:400:kworker.0 00000100:00100000:1.0:1788651923.938349:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147606400 00000100:00100000:1.0:1788651923.938356:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147606400 00000100:00100000:1.0:1788651923.938397:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788651923.938412:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147606400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651923.938455:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147606400:12345-0@lo:400:kworker.0 Request processed in 45us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651923.938462:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788651923.938491:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147606912 00000100:00100000:1.0:1788651923.938495:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147606912 00000100:00100000:1.0:1788651923.938517:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147606656 00000100:00100000:1.0:1788651923.938521:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147606656 00000100:00100000:1.0:1788651923.938536:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788651923.938542:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147606912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651923.938586:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147606912:12345-0@lo:400:kworker.0 Request processed in 43us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651923.938592:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788651923.938603:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788651923.938608:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147606656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651923.938642:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147606656:12345-0@lo:400:kworker.0 Request processed in 33us (1546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651923.938648:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788651923.938683:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147606400:0@lo:400:kworker.0 00000100:00100000:1.0:1788651923.938694:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147606912:0@lo:400:kworker.0 00000100:00100000:1.0:1788651923.938722:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147606656:0@lo:400:kworker.0 00000100:00100000:0.0:1788651923.939013:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651923.939034:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147608064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651923.939072:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651923.939109:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147608064 00000100:00100000:0.0:1788651923.939114:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147608064 00000100:00100000:0.0:1788651923.939146:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788651923.939153:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147608064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651923.939177:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788651923.939215:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147608064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651923.939222:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788651923.939271:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147608064:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788651923.939344:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651923.943947:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651923.943969:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147608192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651923.944045:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651923.944089:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147608192 00000100:00100000:3.0:1788651923.944096:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147608192 00000100:00100000:3.0:1788651923.944138:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788651923.944147:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f58fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147608192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788651923.944168:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1788651923.944215:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f58fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147608192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651923.944223:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788651923.944423:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147608192:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1788651923.947135:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:2.0:1788651923.947154:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788651923.947232:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788651923.947245:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788651924.960755:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147608320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651924.960831:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651924.960979:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147608320 00000100:00100000:3.0:1788651924.960987:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147608320 00000100:00100000:3.0:1788651924.961044:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788651924.961052:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147608320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651924.961082:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651924.961130:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147608320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651924.961137:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788651924.961182:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147608320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788651924.963343:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651924.963398:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651924.963419:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147608448:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651924.963483:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651924.965312:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147608448 00000100:00100000:0.0:1788651924.965328:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147608448 00000100:00100000:0.0:1788651924.965399:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788651924.965409:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147608448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788651924.965439:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651924.965522:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147608448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 115us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651924.965540:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788651924.965719:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147608448:0@lo:13:osp-pre-0-1.0 00000040:00080000:3.0:1788651925.602113:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788651925.984737:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651925.985406:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147608576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788651925.985483:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788651925.985491:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651925.985628:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147608576 00000100:00100000:3.0:1788651925.985638:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147608576 00000100:00100000:3.0:1788651925.985696:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788651925.985705:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147608576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651925.985861:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651925.986348:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147608576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 642us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651925.986356:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788651925.987397:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147608576:0@lo:41:osp-pre-1-0.0 00000040:00080000:3.0:1788651926.244104:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651926.244115:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651926.244218:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788651926.244226:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:2.0:1788651926.662876:0:14554:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 19:45:24 (1788651924) 00010000:00010000:3.0:1788651927.009812:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651927.520214:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651927.520241:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147608704:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651927.520340:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651927.520640:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147608704 00000100:00100000:0.0:1788651927.520650:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147608704 00000100:00100000:0.0:1788651927.520706:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788651927.520716:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147608704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788651927.520750:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788651927.521081:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147608704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 366us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651927.521089:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1788651927.521306:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d5bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147608704:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788651927.715079:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651927.715128:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651927.715182:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651927.715217:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651927.715235:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651927.715257:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651927.715284:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651927.715314:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125514752 00000100:00100000:1.0:1788651927.715324:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125514752 00000100:00100000:2.0:1788651927.715490:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125514496 00000100:00100000:2.0:1788651927.715509:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125514496 00000100:00100000:2.0:1788651927.715563:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 392 00000100:00100000:0.0:1788651927.715565:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125515008 00000100:00100000:0.0:1788651927.715571:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125515008 00000100:00100000:2.0:1788651927.715576:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125514496:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651927.715611:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125514880 00000100:00100000:0.0:1788651927.715616:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125514880 00000100:00100000:0.0:1788651927.715644:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 130 00000100:00100000:0.0:1788651927.715654:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125515008:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651927.715664:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125514496:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 91us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651927.715673:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 392 00000100:00100000:0.0:1788651927.715694:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125515008:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 41us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651927.715702:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 130 00000100:00100000:2.0:1788651927.715711:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125515264 00000100:00100000:2.0:1788651927.715716:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125515264 00000100:00100000:0.0:1788651927.715723:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 131 00000100:00100000:0.0:1788651927.715732:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125514880:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651927.715761:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125514880:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 30us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651927.715769:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 131 00000100:00100000:1.0:1788651927.715771:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125514624 00000100:00100000:1.0:1788651927.715777:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125514624 00000100:00100000:3.0:1788651927.715844:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125515136 00000100:00100000:3.0:1788651927.715849:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125515136 00000100:00100000:0.0:1788651927.715896:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 327 00000100:00100000:0.0:1788651927.715904:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125514752:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651927.715967:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125514752:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 64us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651927.715973:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 327 00000100:00100000:2.0:1788651927.718121:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 328 00000100:00100000:2.0:1788651927.718141:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125515264:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651927.718207:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125515264:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 77us (2989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651927.718213:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 328 00000100:00080000:2.0:1788651927.718249:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788651927.718254:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651927.718257:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788651927.718259:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651927.722216:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 329 00000100:00100000:1.0:1788651927.722244:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:2389:x1875537125514624:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651927.722348:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:2389:x1875537125514624:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 119us (7111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651927.722356:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 329 00000100:00100000:3.0:1788651927.727954:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 330 00000100:00100000:3.0:1788651927.727971:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125515136:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651927.728056:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125515136:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 91us (12771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651927.728064:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 330 00010000:00010000:3.0:1788651928.032838:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651928.379757:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651928.380139:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125515520 00000100:00100000:1.0:1788651928.380151:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125515520 00000100:00100000:1.0:1788651928.380275:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 150 00000100:00100000:1.0:1788651928.380287:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:12168:x1875537125515520:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651928.380309:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651928.380330:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c460a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33dfb expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.380403:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4611 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.380437:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4611 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.380450:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4611 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.380482:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4618 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.380489:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4618 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.380495:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4618 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.380712:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c461f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.380721:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c461f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.380728:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c461f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651928.380738:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788651928.381026:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4611 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381034:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4611 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381042:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4611 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381123:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651928.381128:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4611 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381135:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4611 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381146:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f85c3352f00) 00010000:00010000:1.0:1788651928.381150:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651928.381155:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4611 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381161:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c4611 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381174:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4618 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381180:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4618 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381186:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4618 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381191:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651928.381194:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4618 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381199:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4618 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381220:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f85c3372100) 00010000:00010000:1.0:1788651928.381224:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651928.381229:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4618 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381234:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4618 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381654:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c460a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dfb expref: 16 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381669:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c461f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dfb expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651928.381676:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:1.0:1788651928.381678:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651928.381681:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414e00, rc 0) 00000100:00100000:1.0:1788651928.382093:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:12168:x1875537125515520:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 1806us (2345us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788651928.382102:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 150 00000100:00100000:1.0:1788651928.390275:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651928.390356:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125515648 00000100:00100000:3.0:1788651928.390365:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125515648 00000100:00100000:3.0:1788651928.390424:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 151 00000100:00100000:3.0:1788651928.390434:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:12168:x1875537125515648:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788651928.390589:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:12168:x1875537125515648:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 Request processed in 156us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651928.390596:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 151 00000100:00100000:1.0:1788651928.399359:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651928.399658:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125515776 00000100:00100000:2.0:1788651928.399667:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125515776 00000100:00100000:2.0:1788651928.399734:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 12 00000100:00100000:2.0:1788651928.399744:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:2390:x1875537125515776:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651928.399759:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651928.399783:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c461f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dfb expref: 15 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651928.401286:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:2.0:1788651928.401312:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651928.401402:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:2390:x1875537125515776:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 1655us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651928.401419:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 12 00000100:00100000:3.0:1788651928.416602:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651928.416813:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125515904 00000100:00100000:0.0:1788651928.416823:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125515904 00000100:00100000:0.0:1788651928.416947:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 152 00000100:00100000:0.0:1788651928.416957:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:12168:x1875537125515904:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788651928.417078:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:12168:x1875537125515904:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 Request processed in 122us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651928.417085:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 152 00000040:00080000:3.0:1788651928.680379:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788651929.056227:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147608832:0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.056309:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651929.056962:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147608832 00000100:00100000:0.0:1788651929.056971:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147608832 00000100:00100000:0.0:1788651929.057034:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:0.0:1788651929.057044:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147608832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.057262:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147609344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651929.057865:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651929.059188:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147608832:12345-0@lo:400:kworker.0 Request processed in 2142us (2876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651929.059327:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:2.0:1788651929.059379:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147608832:0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.059412:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147609856:0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.059465:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651929.059492:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147610368:0@lo:400:kworker.0 00000100:00100000:1.0:1788651929.059499:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147609216:0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.059514:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651929.059527:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651929.059542:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147608960:0@lo:400:kworker.0 00000100:00100000:1.0:1788651929.059545:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147609728:0@lo:400:kworker.0 00000100:00100000:1.0:1788651929.059563:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651929.059571:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147609344 00000100:00100000:2.0:1788651929.059577:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147609344 00000100:00100000:1.0:1788651929.059593:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147610240:0@lo:400:kworker.0 00000100:00100000:1.0:1788651929.059615:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651929.059621:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788651929.059629:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147609344:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651929.059641:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147609088:0@lo:400:kworker.0 00002000:00000024:2.0:1788651929.059659:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788651929.059665:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651929.059680:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147609600:0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.059695:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147609344:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651929.059700:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651929.059701:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788651929.059713:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147610112:0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.059718:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147609856 00000100:00100000:2.0:1788651929.059721:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147609856 00000100:00100000:1.0:1788651929.059733:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651929.059742:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147610368 00000100:00100000:2.0:1788651929.059751:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147610368 00000100:00100000:1.0:1788651929.059759:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147609216 00000100:00100000:1.0:1788651929.059762:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147609216 00000100:00100000:2.0:1788651929.059774:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788651929.059781:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147609856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.059813:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147609856:12345-0@lo:400:kworker.0 Request processed in 34us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651929.059819:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788651929.059829:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788651929.059835:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147610368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.059860:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147610368:12345-0@lo:400:kworker.0 Request processed in 25us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651929.059865:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788651929.059881:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651929.059895:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147609472:0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.059934:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651929.059952:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147609984:0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.059972:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788651929.059996:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651929.060000:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651929.060008:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147609728 00000100:00100000:2.0:1788651929.060011:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147609728 00000100:00100000:2.0:1788651929.060036:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147610240 00000100:00100000:3.0:1788651929.060167:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147609984 00000100:00100000:3.0:1788651929.060172:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147609984 00000100:00100000:3.0:1788651929.060195:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788651929.060713:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147609984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.060814:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147610240 00000100:00100000:2.0:1788651929.060841:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147609600 00000100:00100000:2.0:1788651929.060844:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147609600 00000100:00100000:2.0:1788651929.060856:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147610112 00000100:00100000:2.0:1788651929.060858:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147610112 00000100:00100000:2.0:1788651929.060868:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147608960 00000100:00100000:2.0:1788651929.060870:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147608960 00000100:00100000:2.0:1788651929.060880:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788651929.060894:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147609728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651929.062629:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788651929.062643:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147610240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.062647:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147609728:12345-0@lo:400:kworker.0 Request processed in 1753us (3082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651929.062654:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788651929.062676:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788651929.062683:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147609600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651929.062686:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147610240:12345-0@lo:400:kworker.0 Request processed in 50us (3071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651929.062692:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788651929.062705:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788651929.062710:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147609600:12345-0@lo:400:kworker.0 Request processed in 29us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651929.062711:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147610112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.062716:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788651929.062726:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788651929.062731:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147608960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651929.062735:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147610112:12345-0@lo:400:kworker.0 Request processed in 25us (3002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651929.062741:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788651929.062756:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147608960:12345-0@lo:400:kworker.0 Request processed in 25us (2874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651929.062761:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00100000:2.0:1788651929.062790:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147609088 00000100:00100000:2.0:1788651929.062798:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147609088 00000100:00100000:2.0:1788651929.062826:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147609472 00000100:00100000:2.0:1788651929.062830:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147609472 00000100:00100000:2.0:1788651929.062842:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788651929.062847:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fb1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147609088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.062883:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fb1c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147609088:12345-0@lo:400:kworker.0 Request processed in 35us (3216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651929.062888:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788651929.062899:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788651929.062905:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147609472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.062950:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147609472:12345-0@lo:400:kworker.0 Request processed in 45us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651929.062973:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147609984:12345-0@lo:400:kworker.0 Request processed in 2771us (2999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651929.062977:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1788651929.062981:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:2.0:1788651929.062997:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788651929.063001:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788651929.063004:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788651929.063022:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c358ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147610496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788651929.063325:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651929.063515:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788651929.063522:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147609216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651929.063559:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147609216:12345-0@lo:400:kworker.0 Request processed in 38us (4031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651929.063565:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788651929.063646:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147609088:0@lo:400:kworker.0 00000100:00100000:1.0:1788651929.063659:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147609600:0@lo:400:kworker.0 00000100:00100000:1.0:1788651929.063669:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147610112:0@lo:400:kworker.0 00000100:00100000:1.0:1788651929.063727:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147609216:0@lo:400:kworker.0 00010000:00080000:1.0:1788651929.063741:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86eeaeed80 x1875537147609728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651929.063750:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147609728:0@lo:400:kworker.0 00010000:00080000:1.0:1788651929.063762:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c34b3100 x1875537147610240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651945 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788651929.063966:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651929.064082:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147610240:0@lo:400:kworker.0 00000100:00100000:1.0:1788651929.064132:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeaec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147609856:0@lo:400:kworker.0 00000100:00100000:1.0:1788651929.064144:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c34b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147610368:0@lo:400:kworker.0 00000100:00100000:1.0:1788651929.064165:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147609344:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651929.065304:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ea15d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147608960:0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.065319:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c37c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147609472:0@lo:400:kworker.0 00000100:00100000:2.0:1788651929.065330:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147609984:0@lo:400:kworker.0 00000100:00100000:3.0:1788651929.065365:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147610496 00000100:00100000:3.0:1788651929.065371:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147610496 00000100:00100000:2.0:1788651929.065421:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788651929.065431:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147610496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651929.065463:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788651929.065520:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147610496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (2195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651929.065531:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788651929.066483:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c358ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147610496:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788651929.321647:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651929.321656:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651929.322206:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788651929.322219:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788651930.080536:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651930.080560:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147610624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788651930.080632:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651930.080848:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147610624 00000100:00100000:3.0:1788651930.080858:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147610624 00000100:00100000:3.0:1788651930.080933:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788651930.080944:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147610624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651930.080979:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651930.081035:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147610624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651930.081059:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788651930.081201:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147610624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788651930.081382:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651930.081427:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788651930.081446:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147610752:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651930.081479:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651930.081734:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147610752 00000100:00100000:2.0:1788651930.081740:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147610752 00000100:00100000:2.0:1788651930.081777:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788651930.081784:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147610752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788651930.081797:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788651930.081839:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147610752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 55us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651930.081854:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788651930.081986:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3588e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147610752:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651930.372504:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651930.373885:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125516032 00000100:00100000:2.0:1788651930.373900:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125516032 00000100:00100000:2.0:1788651930.374178:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 153 00000100:00100000:2.0:1788651930.374189:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:12211:x1875537125516032:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651930.374210:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788651930.374215:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788651930.374230:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c462d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e02 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374512:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4634 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374527:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374539:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374554:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c463b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374561:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c463b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374572:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c463b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374614:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4634 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374621:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4634 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374637:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4634 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374643:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651930.374647:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4634 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374655:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4634 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374667:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:2.0:1788651930.374670:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651930.374674:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4634 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374680:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4634 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374692:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c463b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374698:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c463b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374703:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c463b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374708:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651930.374711:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c463b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374726:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c463b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374736:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f86c3228400) 00010000:00010000:2.0:1788651930.374738:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651930.374741:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c463b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374747:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c463b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374780:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c462d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e02 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374790:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:2.0:1788651930.374793:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651930.374797:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c462d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e02 expref: 15 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.374807:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7200, rc 0) 00000100:00100000:2.0:1788651930.374876:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:12211:x1875537125516032:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 689us (2378us total) trans 0 rc 301/301 00000100:00100000:2.0:1788651930.378648:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 153 00000100:00100000:1.0:1788651930.391013:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651930.391154:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125516288 00000100:00100000:3.0:1788651930.391167:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125516288 00000100:00100000:3.0:1788651930.391233:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 154 00000100:00100000:3.0:1788651930.391244:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:12211:x1875537125516288:12345-192.168.204.45@tcp:36:lfs.0 00010000:00010000:3.0:1788651930.391308:0:10110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651930.391339:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd200/0xcd2f56ea038c3f81 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c26 expref: 14 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.391362:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:3.0:1788651930.391367:0:10110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651930.391441:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.391456:0:10110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33df4 expref: 5 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.391466:0:10110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.391498:0:10110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33df4 expref: 5 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.391512:0:10110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33df4 expref: 5 pid: 10110 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651930.391551:0:10110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147610880:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651930.391648:0:10110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbcb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651930.398995:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651930.399100:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125516416 00000100:00100000:1.0:1788651930.399109:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125516416 00010000:00010000:1.0:1788651930.399169:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33df4 expref: 6 pid: 10110 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651930.399177:0:10110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c88e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147610880:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651930.399208:0:10110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651930.399210:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 78 00000100:00100000:1.0:1788651930.399223:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125516416:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651930.399241:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651930.399264:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33df4 expref: 6 pid: 10110 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.399277:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33df4 expref: 6 pid: 10110 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.399302:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4603 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33df4 expref: 6 pid: 10110 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.399315:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:1.0:1788651930.399320:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.399329:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.399337:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.399368:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651930.399419:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125516416:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 198us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651930.399438:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 78 00010000:00010000:2.0:1788651930.399456:0:10110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788651930.399462:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788651930.399469:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.399506:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.399516:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.399524:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405383:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405404:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405417:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651930.405442:0:10110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044a6a08d reply state 00000000cf9c4ad5 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405454:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405461:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651930.405464:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651930.405468:0:10110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788651930.405473:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788651930.405481:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405487:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405499:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405505:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651930.405509:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405517:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405526:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368e00) 00010000:00010000:2.0:1788651930.405529:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651930.405532:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405538:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906400/0xcd2f56ea038c4642 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651930.405552:0:10110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044a6a08d reply state 00000000cf9c4ad5 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405560:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.405566:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f86c3228b00) 00010000:00010000:2.0:1788651930.405568:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651930.405570:0:10110:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788651930.405664:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:12211:x1875537125516288:12345-192.168.204.45@tcp:36:lfs.0 Request processed in 14419us (14666us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788651930.405674:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 154 00000100:00100000:3.0:1788651930.515128:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651930.515165:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125516544 00000100:00100000:3.0:1788651930.515175:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125516544 00000100:00100000:3.0:1788651930.515227:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 155 00000100:00100000:3.0:1788651930.515238:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+15:12219:x1875537125516544:12345-192.168.204.45@tcp:101:lctl.0 00010000:00010000:3.0:1788651930.515262:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651930.515284:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c4657 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e09 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.515351:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c465e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.515366:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c465e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.515378:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c465e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651930.515433:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788651930.515438:0:12192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788651930.515459:0:12192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c465e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.515495:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c4657 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e09 expref: 17 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.515511:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c465e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e09 expref: 16 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.515520:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:3.0:1788651930.515523:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651930.515527:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907800, rc 0) 00000100:00100000:3.0:1788651930.515581:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:12219:x1875537125516544:12345-192.168.204.45@tcp:101:lctl.0 Request processed in 346us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651930.515588:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 155 00000100:00100000:1.0:1788651930.609728:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651930.610025:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125516672 00000100:00100000:2.0:1788651930.610037:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125516672 00000100:00100000:2.0:1788651930.610105:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 156 00000100:00100000:2.0:1788651930.610117:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+16:12225:x1875537125516672:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651930.610140:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651930.610166:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4665 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e10 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610247:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c466c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610263:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c466c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610274:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c466c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610286:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4673 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610292:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610297:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610388:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c467a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610396:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c467a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610433:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c467a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651930.610470:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788651930.610474:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651930.610497:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c467a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610511:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c466c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610517:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c466c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610523:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c466c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610529:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651930.610534:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c466c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610542:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c466c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610553:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651930.610557:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651930.610562:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c466c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610568:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c466c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610593:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4673 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610600:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4673 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610606:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610612:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651930.610614:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4673 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610620:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4673 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610628:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f86c3228b00) 00010000:00010000:2.0:1788651930.610630:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651930.610633:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4673 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610638:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4673 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610667:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4665 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e10 expref: 18 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610681:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c467a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e10 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.610701:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651930.610703:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788651930.610706:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7e00, rc 0) 00000100:00100000:2.0:1788651930.610793:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:12225:x1875537125516672:12345-192.168.204.45@tcp:101:bash.0 Request processed in 678us (1074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651930.610801:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 156 00000100:00100000:3.0:1788651930.615111:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651930.615404:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125516928 00000100:00100000:2.0:1788651930.615415:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125516928 00000100:00100000:2.0:1788651930.615479:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 157 00000100:00100000:2.0:1788651930.615488:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+17:12225:x1875537125516928:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651930.615508:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651930.615532:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4681 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e17 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.615659:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c4688 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.615677:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c4688 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.615689:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c4688 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.620432:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.620460:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.620495:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788651930.621202:0:10110:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788651930.621356:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4696 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621368:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621375:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4696 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621407:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c4688 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621413:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c4688 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621447:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c4688 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621453:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651930.621458:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c4688 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621464:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c4688 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621475:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651930.621478:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651930.621494:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c4688 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621503:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c4688 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651930.621523:0:10110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004cbf2bff reply state 00000000f762a408 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621533:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621541:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f86c3228100) 00010000:00010000:2.0:1788651930.621543:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651930.621546:0:10110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788651930.621584:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4681 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e17 expref: 20 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621598:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e17 expref: 19 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.621605:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:2.0:1788651930.621607:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651930.621610:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6000, rc 0) 00000100:00100000:2.0:1788651930.621694:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:12225:x1875537125516928:12345-192.168.204.45@tcp:101:bash.0 Request processed in 6206us (6595us total) trans 4294967419 rc 0/0 00000100:00100000:2.0:1788651930.623744:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 157 00000100:00100000:3.0:1788651930.632463:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651930.632742:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125517056 00000100:00100000:2.0:1788651930.632753:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125517056 00000100:00100000:2.0:1788651930.632843:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00100000:2.0:1788651930.632864:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125517056:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651930.632902:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651930.632962:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c46a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e1e expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651930.632996:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788651930.633018:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1788651930.633024:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651930.633034:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c46a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e1e expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.633054:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c46a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e1e expref: 6 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.633069:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7a00, rc 0) 00000100:00100000:2.0:1788651930.633127:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3663480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125517056:12345-192.168.204.45@tcp:101:bash.0 Request processed in 266us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651930.633135:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00080000:0.0:1788651930.633375:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788651930.645950:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651930.646104:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125517184 00000100:00100000:2.0:1788651930.646118:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125517184 00000100:00100000:2.0:1788651930.646353:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:2.0:1788651930.646365:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:12225:x1875537125517184:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651930.646385:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651930.646404:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e25 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.646452:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c46a4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e1e expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.646477:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651930.646482:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651930.646500:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.646537:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c46a4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e1e expref: 7 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.646551:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c46a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e1e expref: 7 pid: 8427 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651930.646564:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875537147611008:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651930.646673:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788651930.655586:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651930.657051:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125517312 00000100:00100000:0.0:1788651930.657066:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125517312 00010000:00010000:0.0:1788651930.657133:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c46a4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e1e expref: 8 pid: 8427 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651930.657194:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 79 00000100:00100000:0.0:1788651930.657205:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2388:x1875537125517312:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651930.657221:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651930.657257:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c46a4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e1e expref: 8 pid: 8427 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.657274:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c46a4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e1e expref: 8 pid: 8427 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.657300:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651930.657305:0:6496:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651930.657315:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.657327:0:6496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.657367:0:6496:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651930.657383:0:6496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3589880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6496:1875537147611136:192.168.204.45@tcp:105: 00000100:00100000:0.0:1788651930.657491:0:6496:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2d32840 going to sleep for 11 seconds 00010000:00010000:2.0:1788651930.660863:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c46a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e1e expref: 8 pid: 8427 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651930.660889:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875537147611008:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651930.660956:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.660972:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6800, rc 0) 00000100:00100000:0.0:1788651930.661547:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:12225:x1875537125517184:12345-192.168.204.45@tcp:101:bash.0 Request processed in 15183us (15603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651930.661571:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:0.0:1788651930.663332:0:6496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3589880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6496:1875537147611136:192.168.204.45@tcp:105: 00010000:00010000:0.0:1788651930.663359:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651930.663463:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125517312:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 6259us (7888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651930.663474:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 79 00000100:00100000:1.0:1788651930.667813:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651930.668101:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125517568 00000100:00100000:0.0:1788651930.668112:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125517568 00000100:00100000:0.0:1788651930.668349:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 36 00000100:00100000:0.0:1788651930.668362:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:12225:x1875537125517568:12345-192.168.204.45@tcp:35:bash.0 00000100:00100000:0.0:1788651930.668676:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:12225:x1875537125517568:12345-192.168.204.45@tcp:35:bash.0 Request processed in 317us (872us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788651930.668685:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 36 00000100:00100000:0.0:1788651930.769179:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651930.769264:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125517824 00000100:00100000:3.0:1788651930.769274:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125517824 00000100:00100000:3.0:1788651930.769341:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 158 00000100:00100000:3.0:1788651930.769352:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:12235:x1875537125517824:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651930.769378:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651930.769398:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c46b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e2c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651930.769523:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788651930.769644:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c46b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e2c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.769676:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:3.0:1788651930.769679:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651930.769685:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c46b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e2c expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.769699:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907200, rc 0) 00000100:00100000:3.0:1788651930.769772:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:12235:x1875537125517824:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 422us (787us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1788651930.769781:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 158 00000100:00100000:1.0:1788651930.775471:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651930.780349:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125518080 00000100:00100000:3.0:1788651930.780365:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125518080 00000100:00100000:3.0:1788651930.780595:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 37 00000100:00100000:3.0:1788651930.780607:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:12235:x1875537125518080:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:3.0:1788651930.780879:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:12235:x1875537125518080:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 273us (5417us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788651930.780887:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 37 00000100:00100000:1.0:1788651930.789881:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651930.790079:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125518208 00000100:00100000:3.0:1788651930.790096:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125518208 00002000:00100000:3.0:1788651930.790155:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8f86eeaefb80 x1875537125518208/t0(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:316/0 lens 504/0 e 0 to 0 dl 1788651941 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651930.790166:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86eeaefb80 with x1875537125518208 ext(0->12) 00002000:00010000:3.0:1788651930.790171:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f86eeaefb80 00000100:00100000:3.0:1788651930.790194:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:3.0:1788651930.790203:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125518208:12345-192.168.204.45@tcp:4:bash.0 00000100:00100000:1.0:1788651930.795873:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651930.796215:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125518336 00000100:00100000:3.0:1788651930.796235:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125518336 00000100:00100000:3.0:1788651930.796290:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:3.0:1788651930.796300:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c34adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2389:x1875537125518336:12345-192.168.204.45@tcp:16:kworker.0 00000100:00100000:3.0:1788651930.799052:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2389:x1875537125518208:12345-192.168.204.45@tcp:4:bash.0 Request processed in 8835us (9167us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788651930.799068:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 4 00002000:00100000:3.0:1788651930.799080:0:8434:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff8f86eeaefb80 x1875537125518208/t4294967306(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:316/0 lens 504/448 e 0 to 0 dl 1788651941 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788651930.799090:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86eeaefb80 with x1875537125518208 ext(0->12) 00002000:00010000:3.0:1788651930.799097:0:8434:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8f86eeaefb80 00000001:00080000:2.0:1788651930.803784:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:3.0:1788651930.804117:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c34adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125518336:12345-192.168.204.45@tcp:16:kworker.0 Request processed in 7809us (8244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651930.804129:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:1.0:1788651930.892558:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651930.892737:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125518464 00000100:00100000:2.0:1788651930.892754:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125518464 00000100:00100000:2.0:1788651930.892812:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 159 00000100:00100000:2.0:1788651930.892823:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:12241:x1875537125518464:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651930.892847:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651930.892870:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c46c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e33 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.892963:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c46c7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.892978:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c46c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.892991:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c46c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651930.893097:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788651930.893101:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651930.893122:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c46c7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.893214:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c46c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e33 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.893384:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c46c7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e33 expref: 24 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.893394:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651930.893397:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651930.893400:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7c00, rc 0) 00000100:00100000:2.0:1788651930.893479:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:12241:x1875537125518464:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 657us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651930.893486:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 159 00000100:00100000:1.0:1788651930.900820:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651930.901017:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125518720 00000100:00100000:2.0:1788651930.901026:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125518720 00000100:00100000:2.0:1788651930.901147:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 160 00000100:00100000:2.0:1788651930.901158:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:12241:x1875537125518720:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651930.901182:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651930.901204:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c46ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e3a expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.901338:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c46d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.901364:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c46d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.901377:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c46d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651930.901388:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788651930.901506:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c46ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e3a expref: 27 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.901536:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c46d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e3a expref: 26 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.901545:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:2.0:1788651930.901548:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651930.901565:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6400, rc 0) 00000100:00100000:2.0:1788651930.901670:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+26:12241:x1875537125518720:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 514us (860us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1788651930.901678:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 160 00000100:00100000:1.0:1788651930.911200:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651930.911287:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651930.911404:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125518976 00000100:00100000:0.0:1788651930.911429:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125518976 00000100:00100000:0.0:1788651930.911492:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 161 00000100:00100000:0.0:1788651930.911502:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+26:12241:x1875537125518976:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651930.911640:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651930.911662:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46e3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e41 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651930.911725:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125519104 00010000:00010000:0.0:1788651930.911773:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c46ea lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651930.911785:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125519104 00010000:00010000:0.0:1788651930.911788:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c46ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.911814:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c46ea lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651930.911826:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00000100:00100000:3.0:1788651930.911863:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:3.0:1788651930.911871:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+28:2388:x1875537125519104:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651930.911882:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651930.911899:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c46d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e3a expref: 28 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.911958:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:3.0:1788651930.911964:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651930.912121:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+28:2388:x1875537125519104:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 250us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651930.912138:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 13 00010000:00010000:0.0:1788651930.912171:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46e3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e41 expref: 28 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.912187:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c46ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e41 expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.912194:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:0.0:1788651930.912197:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788651930.912200:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96e00, rc 0) 00000100:00100000:0.0:1788651930.912226:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12241:x1875537125518976:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 726us (938us total) trans 4294967424 rc 0/0 00000100:00100000:0.0:1788651930.912233:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 161 00000100:00100000:1.0:1788651930.924673:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651930.928650:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125519232 00000100:00100000:3.0:1788651930.928669:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125519232 00000100:00100000:3.0:1788651930.928795:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:3.0:1788651930.928807:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125519232:12345-192.168.204.45@tcp:1:lfs.0 00010000:00010000:3.0:1788651930.928856:0:8744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.928876:0:8744:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.928884:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651930.928889:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788651930.928894:0:8744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.929121:0:8744:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.929137:0:8744:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 6 pid: 8428 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651930.929152:0:8744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3660380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8744:1875537147611264:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651930.929368:0:8744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651930.932517:0:8744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3660380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8744:1875537147611264:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651930.932566:0:8744:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651930.933627:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651930.933827:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125519360 00000100:00100000:2.0:1788651930.933837:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125519360 00010000:00010000:2.0:1788651930.933876:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 7 pid: 8428 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651930.933960:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 80 00000100:00100000:2.0:1788651930.933969:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125519360:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651930.933984:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788651930.934002:0:7919:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788651930.934005:0:7919:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788651930 00002000:00010000:2.0:1788651930.934007:0:7919:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788651930 00002000:00010000:2.0:1788651930.934010:0:7919:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788651930.934016:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 7 pid: 8428 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.934030:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 7 pid: 8428 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.934052:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c46ab lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e25 expref: 7 pid: 8428 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.934068:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651930.934072:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651930.934089:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.934100:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651930.934133:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651930.934163:0:8744:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.934176:0:8744:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651930.934192:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125519360:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 219us (566us total) trans 0 rc 0/0 00010000:00010000:3.0:1788651930.934199:0:8744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651930.934204:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 80 00010000:00010000:3.0:1788651930.934214:0:8744:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.934223:0:8744:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.934290:0:8744:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788651930.934303:0:8744:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.934314:0:8744:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.934328:0:8744:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651930.934344:0:8744:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e3d2f14/0xcd2f56ea038c46f8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651930.934394:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125519232:12345-192.168.204.45@tcp:1:lfs.0 Request processed in 5590us (9733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651930.934402:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:2.0:1788651930.939596:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651930.939706:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125519616 00000100:00100000:0.0:1788651930.939716:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125519616 00000100:00100000:0.0:1788651930.939786:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 38 00000100:00100000:0.0:1788651930.939796:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12241:x1875537125519616:12345-192.168.204.45@tcp:35:lfs.0 00000004:00010000:0.0:1788651930.940204:0:6513:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c46ea lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e41 expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651930.940531:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1788651930.940568:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788651930.941472:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:0.0:1788651930.941594:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.941622:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4696 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e17 expref: 31 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.941632:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.941669:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e17 expref: 31 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.941685:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4696 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e17 expref: 31 pid: 10110 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651930.942809:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3588000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6513:1875537147611392:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651930.942955:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2d329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651930.946574:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3588000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6513:1875537147611392:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651930.946602:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651930.949127:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651930.950388:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125519744 00000100:00100000:1.0:1788651930.950401:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125519744 00010000:00010000:1.0:1788651930.950461:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4696 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e17 expref: 32 pid: 10110 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651930.950511:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 81 00000100:00100000:1.0:1788651930.950521:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:2388:x1875537125519744:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651930.950536:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651930.950543:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4696 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e17 expref: 32 pid: 10110 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.950557:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4696 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e17 expref: 32 pid: 10110 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.950582:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4696 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e17 expref: 32 pid: 10110 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.950602:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:1.0:1788651930.950608:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.950618:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.950645:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651930.950950:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651930.951038:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+31:2388:x1875537125519744:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 517us (1920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651930.951046:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 81 00010000:00010000:0.0:1788651930.951162:0:6513:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.951171:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651930.951641:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:0.0:1788651930.952105:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1788651930.952205:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3588000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1875537147611520:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788651930.952353:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651930.952441:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3fc8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788651930.955034:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147611520 00000100:00100000:2.0:1788651930.955050:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147611520 00000100:00100000:2.0:1788651930.955120:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788651930.955131:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1875537147611520:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788651930.955446:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6513:x1875537147611520:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 316us (3092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651930.955454:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788651930.955875:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3588000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1875537147611520:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788651930.956045:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:0.0:1788651930.956115:0:6513:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3588000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1875537147611648:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788651930.956155:0:6513:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651930.956186:0:6513:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2d32840 going to sleep for 11 seconds 00000100:00100000:3.0:1788651930.956370:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147611648 00000100:00100000:3.0:1788651930.956376:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147611648 00000100:00100000:3.0:1788651930.956463:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1788651930.956472:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6513:x1875537147611648:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788651930.956611:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6513:x1875537147611648:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 139us (455us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788651930.956618:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788651930.956688:0:6513:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3588000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6513:1875537147611648:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788651930.956730:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1788651930.956762:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.956772:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.956779:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.958244:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651930.958252:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.958262:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.958279:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:0.0:1788651930.958283:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788651930.958287:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.958320:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c46ff lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6513 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788651930.958455:0:6513:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788651930.958516:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788651930.958527:0:6513:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386893618675ns, next at 387893615980ns, rc = 0 00000001:00080000:0.0:1788651930.958535:0:6513:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:0.0:1788651930.958572:0:6513:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f86c3228f00) 00010000:00010000:0.0:1788651930.958575:0:6513:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788651930.958583:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c46ea lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e41 expref: 35 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651930.958876:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6ed850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:12241:x1875537125519616:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 19080us (19289us total) trans 4294967433 rc 0/0 00000100:00100000:0.0:1788651930.958887:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 38 00000020:00080000:0.0:1788651930.958892:0:6513:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788651930.971233:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651930.971375:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125519872 00000100:00100000:1.0:1788651930.971387:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125519872 00000100:00100000:0.0:1788651930.971475:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 162 00000100:00100000:0.0:1788651930.971488:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:12241:x1875537125519872:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651930.971509:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651930.971529:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4706 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e48 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.971582:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4706 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e48 expref: 35 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.971596:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4706 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e48 expref: 35 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651930.971631:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651930.971634:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788651930.971637:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96e00, rc 0) 00000100:00100000:0.0:1788651930.972971:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:12241:x1875537125519872:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 1478us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651930.972984:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 162 00000100:00100000:2.0:1788651930.987621:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651930.987975:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125520128 00000100:00100000:3.0:1788651930.987986:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125520128 00000100:00100000:3.0:1788651930.988044:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 39 00000100:00100000:3.0:1788651930.988054:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:12241:x1875537125520128:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:2.0:1788651930.995196:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+36:12241:x1875537125520128:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 7133us (7577us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788651930.995209:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 39 00010000:00010000:3.0:1788651931.104156:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651931.105038:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147611776:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788651931.105111:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651931.105676:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147611776 00000100:00100000:2.0:1788651931.105687:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147611776 00000100:00100000:2.0:1788651931.105738:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788651931.105748:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147611776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788651931.105798:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788651931.105860:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147611776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651931.105868:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1788651931.105965:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3660380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147611776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788651931.122672:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651931.124749:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125520384 00000100:00100000:2.0:1788651931.124766:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125520384 00000100:00100000:2.0:1788651931.124843:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 163 00000100:00100000:2.0:1788651931.124853:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+36:12251:x1875537125520384:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651931.124877:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651931.124898:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c470d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e4f expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651931.125014:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788651931.125111:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c470d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e4f expref: 38 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.125126:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651931.125129:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651931.125135:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c470d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e4f expref: 38 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.125150:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6e00, rc 0) 00000100:00100000:2.0:1788651931.125228:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3660380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12251:x1875537125520384:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 376us (2566us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1788651931.126129:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 163 00000100:00100000:1.0:1788651931.131552:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651931.131653:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125520512 00000100:00100000:0.0:1788651931.131666:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125520512 00000100:00100000:0.0:1788651931.131744:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 164 00000100:00100000:0.0:1788651931.131756:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12251:x1875537125520512:12345-192.168.204.45@tcp:34:lfs.0 00010000:00010000:0.0:1788651931.131840:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c471b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.131858:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c471b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.131871:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c471b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.131883:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4722 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.131891:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.131897:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132008:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4729 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132043:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132051:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788651931.132102:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132116:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c471b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132127:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c471b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132133:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c471b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132139:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651931.132143:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c471b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132150:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c471b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132160:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:0.0:1788651931.132164:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651931.132172:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c471b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132180:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c471b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132200:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4722 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132206:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4722 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132211:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4722 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132216:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651931.132219:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4722 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132225:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4722 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132232:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f86c3228100) 00010000:00010000:0.0:1788651931.132248:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651931.132251:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4722 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132256:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4722 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132266:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4729 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132271:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4729 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132276:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4729 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132286:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651931.132289:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4729 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132294:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4729 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132302:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651931.132304:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651931.132307:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4729 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.132313:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4729 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651931.132384:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12251:x1875537125520512:12345-192.168.204.45@tcp:34:lfs.0 Request processed in 629us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651931.132391:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 164 00000100:00100000:2.0:1788651931.137507:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651931.137572:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125520768 00000100:00100000:0.0:1788651931.137582:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125520768 00000100:00100000:0.0:1788651931.137641:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 40 00000100:00100000:0.0:1788651931.137652:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12251:x1875537125520768:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:0.0:1788651931.137891:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:12251:x1875537125520768:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 240us (394us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788651931.137898:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 40 00000100:00100000:3.0:1788651931.200120:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651931.200262:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125521024 00000100:00100000:0.0:1788651931.200275:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125521024 00000100:00100000:0.0:1788651931.200352:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 165 00000100:00100000:0.0:1788651931.200379:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:12254:x1875537125521024:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651931.200408:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651931.200442:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4730 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e56 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200526:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4737 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200541:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4737 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200553:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4737 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200563:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c473e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200569:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c473e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200575:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c473e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200693:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4745 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200702:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200709:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4745 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651931.200743:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788651931.200818:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4737 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200826:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4737 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200833:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4737 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200839:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651931.200843:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4737 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200850:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4737 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200864:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:0.0:1788651931.200867:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651931.200871:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4737 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200878:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4737 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200893:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c473e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200900:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c473e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200978:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c473e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200983:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651931.200986:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c473e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.200993:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c473e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.201002:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f86c3228100) 00010000:00010000:0.0:1788651931.201004:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651931.201007:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c473e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.201013:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c473e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.201051:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4730 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e56 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.201065:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4745 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e56 expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.201074:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651931.201076:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651931.201079:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96200, rc 0) 00000100:00100000:0.0:1788651931.201136:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12254:x1875537125521024:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 759us (1028us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788651931.201153:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 165 00000100:00100000:1.0:1788651931.208458:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651931.209652:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125521152 00000100:00100000:2.0:1788651931.209683:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125521152 00000100:00100000:2.0:1788651931.209760:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 166 00000100:00100000:2.0:1788651931.209772:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12254:x1875537125521152:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:2.0:1788651931.209851:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4753 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.209869:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4753 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.209880:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4753 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.209957:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4753 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.209965:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4753 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.209972:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4753 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.209977:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651931.209981:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4753 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.209987:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4753 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.209998:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651931.210001:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651931.210006:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4753 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.210021:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4753 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651931.210102:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12254:x1875537125521152:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 331us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651931.210109:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 166 00000100:00100000:2.0:1788651931.213189:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651931.213325:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125521408 00000100:00100000:0.0:1788651931.213335:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125521408 00000100:00100000:0.0:1788651931.216027:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 41 00000100:00100000:0.0:1788651931.216055:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12254:x1875537125521408:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:0.0:1788651931.216311:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:12254:x1875537125521408:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 269us (3131us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788651931.224370:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 41 00000100:00100000:3.0:1788651931.575044:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651931.575161:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125521664 00000100:00100000:0.0:1788651931.575171:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125521664 00000100:00100000:0.0:1788651931.575237:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 167 00000100:00100000:0.0:1788651931.575249:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:12285:x1875537125521664:12345-192.168.204.45@tcp:101:cat.0 00010000:00010000:0.0:1788651931.575273:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651931.575294:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c475a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e5d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.575441:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4761 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.575455:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.575467:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4761 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651931.575479:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788651931.575609:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c475a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e5d expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.575658:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4761 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e5d expref: 43 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.575666:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651931.575669:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788651931.575673:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96a00, rc 0) 00000100:00100000:0.0:1788651931.575732:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3663b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+43:12285:x1875537125521664:12345-192.168.204.45@tcp:101:cat.0 Request processed in 485us (713us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788651931.575738:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 167 00000100:00100000:1.0:1788651931.582684:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651931.582769:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651931.582969:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125521920 00000100:00100000:2.0:1788651931.582980:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125521920 00000100:00100000:2.0:1788651931.583037:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 42 00000100:00100000:2.0:1788651931.583048:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+43:12285:x1875537125521920:12345-192.168.204.45@tcp:35:cat.0 00000100:00100000:2.0:1788651931.583296:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+44:12285:x1875537125521920:12345-192.168.204.45@tcp:35:cat.0 Request processed in 249us (620us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788651931.583318:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 42 00000100:00100000:3.0:1788651931.583413:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125522048 00000100:00100000:3.0:1788651931.583417:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125522048 00000100:00100000:3.0:1788651931.583477:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:3.0:1788651931.583485:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3390380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+44:2390:x1875537125522048:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651931.583496:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651931.583520:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4761 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e5d expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651931.583539:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:3.0:1788651931.583544:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651931.583566:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3390380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+43:2390:x1875537125522048:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 82us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651931.583573:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 14 00000001:00080000:1.0:1788651931.587209:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000004:00080000:1.0:1788651931.587240:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788651931.587261:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f86c3fc86c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788651931.587266:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c2b9f700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f86c3fc8480 00000020:00080000:1.0:1788651931.587269:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c2b9f900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f85c3613a00 00000020:00080000:3.0:1788651931.587355:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788651931.587432:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788651931.587770:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788651931.587792:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147611904:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788651931.587869:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651931.588503:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588516:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588524:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588531:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651931.588535:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588544:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588565:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8f86c3228b00) 00010000:00010000:0.0:1788651931.588569:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651931.588574:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588600:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4649 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588646:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588653:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588659:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588664:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651931.588667:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588673:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588682:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:0.0:1788651931.588685:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651931.588688:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588694:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4650 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588709:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588725:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588739:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588745:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651931.588748:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588754:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588762:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f86c3228100) 00010000:00010000:0.0:1788651931.588764:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651931.588767:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.588772:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c468f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651931.589178:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147611904 00000100:00100000:2.0:1788651931.589189:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147611904 00000100:00100000:2.0:1788651931.589259:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788651931.589268:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3636:x1875537147611904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788651931.589297:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:2.0:1788651931.589323:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ca99a, atime: 0x0, ctime: 0x6a9ca99a, blocks: 0x8 00010000:00010000:2.0:1788651931.589329:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c476f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.589342:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=387s v=(0 0) 00010000:00010000:2.0:1788651931.589346:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651931.589352:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c476f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.589375:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c476f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.589394:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c476f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.589411:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c476f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.589434:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788651931.589596:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147611904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 329us (1727us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788651931.589603:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:1.0:1788651931.589886:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651931.589894:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c476f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651931.589903:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651931.589935:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c476f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651931.589954:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c476f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651931.589968:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c476f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651931.589976:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000037a4b99/0xcd2f56ea038c476f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651931.589994:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651931.589996:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651931.589998:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788651931.590089:0:3636:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f85c310aa00/2, rc 0, transno 4294967308 00000100:00100000:3.0:1788651931.590097:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147611904:0@lo:6:osp-syn-0-0.0 00000100:00080000:0.0:1788651931.591273:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651931.699042:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651931.699732:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125522304 00000100:00100000:1.0:1788651931.699743:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125522304 00000100:00100000:1.0:1788651931.699804:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 168 00000100:00100000:1.0:1788651931.699815:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:12291:x1875537125522304:12345-192.168.204.45@tcp:101:dd.0 00010000:00010000:1.0:1788651931.699839:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651931.699842:0:12192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788651931.699865:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c46c7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e33 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651931.699884:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:1.0:1788651931.699889:0:12192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651931.699902:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4776 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e64 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651931.700078:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651931.700093:0:12192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4745 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e56 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651931.700101:0:12192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651931.700134:0:12192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4745 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e56 expref: 18 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651931.700147:0:12192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4745 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e56 expref: 18 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651931.700160:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147612032:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651931.700669:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651931.713111:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651931.713223:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125522432 00000100:00100000:3.0:1788651931.713224:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147612032:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651931.713231:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125522432 00010000:00010000:3.0:1788651931.713251:0:12192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.713269:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4745 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e56 expref: 19 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651931.713305:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 82 00000100:00100000:2.0:1788651931.713314:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:2388:x1875537125522432:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651931.713332:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651931.713338:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4745 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e56 expref: 19 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.713349:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4745 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e56 expref: 19 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.713387:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4745 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e56 expref: 19 pid: 6511 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.713417:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651931.713422:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.713431:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.713439:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.713468:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651931.713503:0:12192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651931.713510:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651931.713517:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:2388:x1875537125522432:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 204us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651931.713525:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 82 00000004:00200000:3.0:1788651931.713536:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788651931.714486:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4776 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e64 expref: 19 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.714507:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e64 expref: 18 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.714516:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651931.714519:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788651931.714522:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414800, rc 0) 00000100:00100000:2.0:1788651931.714572:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:12291:x1875537125522304:12345-192.168.204.45@tcp:101:dd.0 Request processed in 14759us (15540us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788651931.714589:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 168 00000100:00100000:1.0:1788651931.716815:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651931.716997:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125522560 00000100:00100000:0.0:1788651931.717008:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125522560 00000100:00100000:0.0:1788651931.717068:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 169 00000100:00100000:0.0:1788651931.717078:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:12291:x1875537125522560:12345-192.168.204.45@tcp:101:dd.0 00010000:00010000:0.0:1788651931.717102:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651931.717123:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c478b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e6b expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.717158:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4792 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.717183:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.717194:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4792 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.717314:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c478b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e6b expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.717332:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4792 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e6b expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651931.717341:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651931.717343:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788651931.717347:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96800, rc 0) 00000100:00100000:0.0:1788651931.717412:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:12291:x1875537125522560:12345-192.168.204.45@tcp:101:dd.0 Request processed in 336us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651931.717419:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 169 00000100:00100000:3.0:1788651931.720680:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651931.720754:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125522816 00000100:00100000:2.0:1788651931.720766:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125522816 00000100:00100000:2.0:1788651931.720830:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 170 00000100:00100000:2.0:1788651931.720841:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:12291:x1875537125522816:12345-192.168.204.45@tcp:36:dd.0 00010000:00010000:2.0:1788651931.721117:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.721135:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.721148:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651931.721192:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:2.0:1788651931.721217:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000291e66b0 reply state 0000000085b25340 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.721229:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651931.721237:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651931.721239:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651931.721243:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651931.721335:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:12291:x1875537125522816:12345-192.168.204.45@tcp:36:dd.0 Request processed in 495us (663us total) trans 4294967443 rc 0/0 00000100:00100000:2.0:1788651931.721344:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 170 00000020:00080000:2.0:1788651931.721348:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788651932.020972:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651932.021090:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125522944 00000100:00100000:1.0:1788651932.021100:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125522944 00000100:00100000:1.0:1788651932.021169:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 171 00000100:00100000:1.0:1788651932.021180:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c37c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:12305:x1875537125522944:12345-192.168.204.45@tcp:101:stat.0 00010000:00010000:1.0:1788651932.021204:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651932.021239:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c47a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e72 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.021317:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c47a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.021331:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c47a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.021342:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c47a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.021356:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c47ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.021364:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c47ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.021371:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c47ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.021455:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.021465:0:12192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e64 expref: 23 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.021473:0:12192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.021506:0:12192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e64 expref: 23 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.021532:0:12192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e64 expref: 23 pid: 12192 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651932.021547:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147612160:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651932.021641:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db900 going to sleep for 11 seconds 00000100:00080000:0.0:1788651932.022025:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651932.024427:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147612160:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651932.024455:0:12192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651932.033187:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651932.033291:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125523200 00000100:00100000:0.0:1788651932.033301:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125523200 00000100:00100000:0.0:1788651932.033362:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 43 00000100:00100000:0.0:1788651932.033374:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:6164:x1875537125523200:12345-192.168.204.45@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788651932.033698:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:6164:x1875537125523200:12345-192.168.204.45@tcp:35:ldlm_bl.0 Request processed in 325us (519us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788651932.033706:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 43 00000100:00100000:1.0:1788651932.040065:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651932.041408:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125523328 00000100:00100000:3.0:1788651932.041422:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125523328 00010000:00010000:3.0:1788651932.041468:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e64 expref: 25 pid: 12192 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651932.041513:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 83 00000100:00100000:3.0:1788651932.041524:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:2389:x1875537125523328:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651932.041539:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651932.041546:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e64 expref: 25 pid: 12192 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.041560:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e64 expref: 25 pid: 12192 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.041584:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c477d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e64 expref: 25 pid: 12192 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.041701:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:3.0:1788651932.041708:0:7919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.041719:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.041728:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.041781:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651932.041814:0:12192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.041822:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651932.041850:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:2389:x1875537125523328:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 328us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651932.041859:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 83 00000004:00200000:2.0:1788651932.041886:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788651932.041890:0:12192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651932.041993:0:12192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042007:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042017:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c47a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042024:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c47a7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042030:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c47a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042036:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651932.042040:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c47a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042060:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c47a7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042070:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651932.042073:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651932.042076:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c47a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042083:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c47a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042094:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c47ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042101:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c47ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042106:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c47ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042111:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651932.042114:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c47ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042119:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c47ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042126:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3374d00) 00010000:00010000:2.0:1788651932.042129:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651932.042132:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c47ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042146:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c47ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042185:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c47a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e72 expref: 24 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042201:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e72 expref: 23 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.042214:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651932.042217:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651932.042219:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415000, rc 0) 00000100:00100000:2.0:1788651932.042246:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c37c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:12305:x1875537125522944:12345-192.168.204.45@tcp:101:stat.0 Request processed in 21070us (21285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651932.042253:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 171 00000100:00100000:3.0:1788651932.111105:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651932.111576:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125523584 00000100:00100000:0.0:1788651932.111604:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125523584 00000100:00100000:0.0:1788651932.111667:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 172 00000100:00100000:0.0:1788651932.111677:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:12311:x1875537125523584:12345-192.168.204.45@tcp:36:truncate.0 00010000:00010000:0.0:1788651932.111751:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651932.111782:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e72 expref: 23 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.111803:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651932.111808:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651932.112049:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.112064:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.112075:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651932.112121:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1788651932.112144:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000258791d5 reply state 0000000002b9c94a transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.112156:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.112163:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651932.112166:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788651932.112168:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788651932.112478:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:12311:x1875537125523584:12345-192.168.204.45@tcp:36:truncate.0 Request processed in 801us (1381us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788651932.112486:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 172 00000020:00080000:0.0:1788651932.112499:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788651932.128321:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651932.296221:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651932.296315:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125523712 00000100:00100000:2.0:1788651932.296325:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125523712 00000100:00100000:2.0:1788651932.296382:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 173 00000100:00100000:2.0:1788651932.296403:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:12325:x1875537125523712:12345-192.168.204.45@tcp:101:stat.0 00010000:00010000:2.0:1788651932.296433:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651932.296454:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c47c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e79 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296544:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c47ca lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296558:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c47ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296584:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c47ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296601:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c47d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296608:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c47d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296614:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c47d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296691:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296716:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296724:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651932.296765:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788651932.296769:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651932.296787:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296800:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296808:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c47ca lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296824:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c47ca lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296831:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c47ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296837:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651932.296841:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c47ca lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296849:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c47ca lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296861:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651932.296864:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651932.296868:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c47ca lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296873:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c47ca lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296887:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c47d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296892:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c47d1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296898:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c47d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296902:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651932.296973:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c47d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296991:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c47d1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.296999:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f86c3228800) 00010000:00010000:2.0:1788651932.297002:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651932.297005:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c47d1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.297011:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c47d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.297043:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7c00/0xcd2f56ea038c47c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e79 expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.297055:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e79 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.297063:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651932.297066:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651932.297068:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7400, rc 0) 00000100:00100000:2.0:1788651932.297132:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+26:12325:x1875537125523712:12345-192.168.204.45@tcp:101:stat.0 Request processed in 740us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651932.297139:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 173 00000100:00100000:2.0:1788651932.409610:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651932.409821:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125523968 00000100:00100000:1.0:1788651932.409833:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125523968 00000100:00100000:1.0:1788651932.409901:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 174 00000100:00100000:1.0:1788651932.409946:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+26:12335:x1875537125523968:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:1.0:1788651932.409969:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651932.409993:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e80 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651932.410336:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788651932.410447:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e80 expref: 28 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.410462:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:1.0:1788651932.410465:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651932.410470:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c47df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e80 expref: 28 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651932.410485:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415000, rc 0) 00000100:00100000:1.0:1788651932.410773:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12335:x1875537125523968:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 828us (1175us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1788651932.410794:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 174 00000100:00100000:3.0:1788651932.413716:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651932.415505:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125524224 00000100:00100000:0.0:1788651932.415522:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125524224 00000100:00100000:0.0:1788651932.415599:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 44 00000100:00100000:0.0:1788651932.415610:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12335:x1875537125524224:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:0.0:1788651932.415870:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6ec850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+28:12335:x1875537125524224:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 260us (2170us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788651932.415879:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 44 00000100:00100000:0.0:1788651932.508174:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651932.508266:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125524480 00000100:00100000:3.0:1788651932.508276:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125524480 00000100:00100000:3.0:1788651932.508335:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 175 00000100:00100000:3.0:1788651932.508345:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+28:12341:x1875537125524480:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:3.0:1788651932.508367:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651932.508396:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c47ed lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e87 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.508502:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.508519:0:10110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e79 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.508528:0:10110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.508563:0:10110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e79 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.508579:0:10110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e79 expref: 29 pid: 6511 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651932.508605:0:10110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147612288:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651932.508721:0:10110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788651932.516044:0:10110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a5a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147612288:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651932.516079:0:10110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651932.517260:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651932.517514:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125524608 00000100:00100000:2.0:1788651932.517524:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125524608 00010000:00010000:2.0:1788651932.517563:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e79 expref: 30 pid: 6511 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651932.517621:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 84 00000100:00100000:2.0:1788651932.517632:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:2388:x1875537125524608:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651932.517647:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651932.517654:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e79 expref: 30 pid: 6511 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.517667:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e79 expref: 30 pid: 6511 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.517689:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c47d8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e79 expref: 30 pid: 6511 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.517716:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651932.517722:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.517733:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.517741:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.518005:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651932.518072:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:2388:x1875537125524608:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 442us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651932.518080:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 84 00010000:00010000:3.0:1788651932.518956:0:10110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.518967:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651932.518986:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788651932.519130:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c47ed lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e87 expref: 30 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.519149:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e87 expref: 29 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.519158:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:3.0:1788651932.519160:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788651932.519163:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907a00, rc 0) 00000100:00100000:3.0:1788651932.519220:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:12341:x1875537125524480:12345-192.168.204.45@tcp:101:bash.0 Request processed in 10875us (11055us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788651932.519229:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 175 00000100:00100000:0.0:1788651932.522869:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651932.523063:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125524864 00000100:00100000:2.0:1788651932.523087:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125524864 00000100:00100000:2.0:1788651932.523140:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 176 00000100:00100000:2.0:1788651932.523149:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:12341:x1875537125524864:12345-192.168.204.45@tcp:36:bash.0 00010000:00010000:2.0:1788651932.523372:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.523401:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.523412:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651932.523458:0:6511:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:2.0:1788651932.523478:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000501cd150 reply state 000000006fef6bdc transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.523491:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.523499:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651932.523502:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651932.523506:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651932.523604:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3662d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:12341:x1875537125524864:12345-192.168.204.45@tcp:36:bash.0 Request processed in 454us (742us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1788651932.523611:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 176 00000020:00080000:2.0:1788651932.523616:0:6511:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788651932.534579:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651932.534683:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125524992 00000100:00100000:2.0:1788651932.534694:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125524992 00000100:00100000:2.0:1788651932.534755:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 177 00000100:00100000:2.0:1788651932.534765:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:12341:x1875537125524992:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651932.534813:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651932.534833:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c4809 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e8e expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.534972:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4810 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.534988:0:12192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e87 expref: 33 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.534997:0:12192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4810 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.535045:0:12192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e87 expref: 33 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.535059:0:12192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e87 expref: 33 pid: 10110 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651932.535072:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147612416:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651932.535160:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788651932.540701:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651932.540866:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125525120 00000100:00100000:0.0:1788651932.540876:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125525120 00010000:00010000:0.0:1788651932.540952:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e87 expref: 34 pid: 10110 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651932.540995:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 85 00000100:00100000:0.0:1788651932.541004:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:2388:x1875537125525120:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651932.541028:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651932.541035:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e87 expref: 34 pid: 10110 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.541049:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e87 expref: 34 pid: 10110 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.541071:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651932.541088:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4810 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.541098:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4810 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.541106:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4810 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.541126:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651932.541182:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:2388:x1875537125525120:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 180us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651932.541190:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 85 00010000:00010000:2.0:1788651932.541947:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907a00/0xcd2f56ea038c47f4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e87 expref: 33 pid: 10110 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651932.541964:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369c700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147612416:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651932.541984:0:12192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4810 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.542005:0:12192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4810 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.542401:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4810 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651932.542459:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788651932.542463:0:12192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651932.542486:0:12192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4810 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.542516:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c4809 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e8e expref: 33 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.542533:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4810 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e8e expref: 32 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.542541:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651932.542544:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651932.542547:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6c00, rc 0) 00000100:00100000:2.0:1788651932.542646:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:12341:x1875537125524992:12345-192.168.204.45@tcp:101:bash.0 Request processed in 7883us (8077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651932.542653:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 177 00000100:00100000:1.0:1788651932.554833:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651932.555013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125525376 00000100:00100000:0.0:1788651932.555023:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125525376 00000100:00100000:0.0:1788651932.555088:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 45 00000100:00100000:0.0:1788651932.555098:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:12341:x1875537125525376:12345-192.168.204.45@tcp:35:bash.0 00000100:00100000:0.0:1788651932.555345:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+33:12341:x1875537125525376:12345-192.168.204.45@tcp:35:bash.0 Request processed in 247us (522us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788651932.555352:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 45 00000100:00100000:3.0:1788651932.640313:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c369c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147612544:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651932.640405:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651932.640538:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147612544 00000100:00100000:0.0:1788651932.640547:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147612544 00000100:00100000:0.0:1788651932.640600:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788651932.640609:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147612544:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788651932.640642:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:0.0:1788651932.640701:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147612544:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651932.640709:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788651932.640796:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c369c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147612544:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788651932.707553:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651932.707643:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125525632 00000100:00100000:3.0:1788651932.707653:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125525632 00000100:00100000:3.0:1788651932.707723:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 178 00000100:00100000:3.0:1788651932.707733:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+33:12351:x1875537125525632:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651932.707761:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651932.707783:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4817 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e95 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651932.707886:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788651932.708034:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4817 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e95 expref: 35 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.708048:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:3.0:1788651932.708051:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651932.708056:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4817 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e95 expref: 35 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.708069:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907200, rc 0) 00000100:00100000:3.0:1788651932.708129:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:12351:x1875537125525632:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 398us (588us total) trans 4294967453 rc 301/301 00000100:00100000:3.0:1788651932.708136:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 178 00000100:00100000:1.0:1788651932.713735:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651932.713826:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125525760 00000100:00100000:0.0:1788651932.713836:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125525760 00000100:00100000:0.0:1788651932.713899:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 179 00000100:00100000:0.0:1788651932.713952:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:12351:x1875537125525760:12345-192.168.204.45@tcp:34:lfs.0 00010000:00010000:0.0:1788651932.714042:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4825 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714060:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4825 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714071:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4825 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714084:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c482c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714090:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c482c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714095:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c482c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714158:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4833 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714167:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714172:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788651932.714369:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714408:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4825 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714414:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4825 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714420:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4825 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714425:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651932.714429:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4825 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714437:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4825 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714450:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:0.0:1788651932.714453:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651932.714458:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4825 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714464:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4825 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714477:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c482c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714482:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c482c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714487:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c482c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714498:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651932.714502:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c482c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714507:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c482c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714516:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3352900) 00010000:00010000:0.0:1788651932.714518:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651932.714521:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c482c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714526:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c482c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714540:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4833 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714546:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4833 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714552:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4833 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714557:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651932.714559:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4833 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714565:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4833 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714584:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651932.714586:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651932.714589:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4833 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.714595:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4833 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651932.714766:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:12351:x1875537125525760:12345-192.168.204.45@tcp:34:lfs.0 Request processed in 856us (1039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651932.714773:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 179 00000100:00100000:1.0:1788651932.724113:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651932.724200:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125526016 00000100:00100000:0.0:1788651932.724210:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125526016 00000100:00100000:0.0:1788651932.724267:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:0.0:1788651932.724278:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:12351:x1875537125526016:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:0.0:1788651932.724502:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:12351:x1875537125526016:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 225us (398us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788651932.724510:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:1.0:1788651932.784628:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651932.784837:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125526272 00000100:00100000:2.0:1788651932.784847:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125526272 00000100:00100000:2.0:1788651932.784905:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 180 00000100:00100000:2.0:1788651932.784963:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:12354:x1875537125526272:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651932.784988:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651932.785022:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c483a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33e9c expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785096:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c4841 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785111:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c4841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785123:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c4841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785137:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4848 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785144:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785151:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785261:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c484f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785271:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c484f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785278:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c484f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651932.785287:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788651932.785355:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c4841 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785372:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c4841 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785389:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c4841 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785395:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651932.785400:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c4841 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785407:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c4841 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785420:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651932.785423:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651932.785427:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c4841 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785433:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c4841 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785448:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4848 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785454:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4848 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785459:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785465:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651932.785474:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4848 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785481:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4848 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785489:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f86c3228800) 00010000:00010000:2.0:1788651932.785492:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651932.785495:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4848 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785501:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4848 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785543:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c483a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e9c expref: 38 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785557:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c484f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e9c expref: 37 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.785564:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651932.785567:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651932.785569:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6600, rc 0) 00000100:00100000:2.0:1788651932.785628:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12354:x1875537125526272:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 667us (1010us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788651932.785636:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 180 00000100:00100000:1.0:1788651932.790272:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651932.790416:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125526400 00000100:00100000:2.0:1788651932.790426:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125526400 00000100:00100000:2.0:1788651932.790486:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 181 00000100:00100000:2.0:1788651932.790495:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12354:x1875537125526400:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:2.0:1788651932.790574:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c485d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.790592:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c485d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.790604:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c485d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.790638:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c485d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.790646:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c485d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.790652:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c485d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.790659:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651932.790663:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c485d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.790671:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c485d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.790684:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651932.790687:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651932.790692:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c485d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.790709:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c485d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651932.790788:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12354:x1875537125526400:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 294us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651932.790795:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 181 00000100:00100000:1.0:1788651932.792255:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651932.792474:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125526528 00000100:00100000:2.0:1788651932.792483:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125526528 00000100:00100000:2.0:1788651932.792534:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:2.0:1788651932.792543:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:2389:x1875537125526528:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651932.792556:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651932.792577:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c484f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e9c expref: 37 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.792594:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651932.792599:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651932.792645:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+36:2389:x1875537125526528:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 103us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651932.792652:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:1.0:1788651932.794644:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651932.794732:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125526784 00000100:00100000:0.0:1788651932.794741:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125526784 00000100:00100000:0.0:1788651932.794792:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:0.0:1788651932.794802:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+36:12354:x1875537125526784:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:0.0:1788651932.795047:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12354:x1875537125526784:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 246us (409us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788651932.795055:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:1.0:1788651932.837325:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651932.837364:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651932.837408:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651932.837444:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651932.837461:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651932.837480:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651932.837551:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125527296 00000100:00100000:3.0:1788651932.837562:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125527296 00000100:00100000:3.0:1788651932.837631:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125527168 00000100:00100000:3.0:1788651932.837634:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125527168 00000100:00100000:3.0:1788651932.837665:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 135 00000100:00100000:3.0:1788651932.837675:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125527296:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651932.837753:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125527296:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 79us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651932.837761:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 135 00000100:00100000:3.0:1788651932.837776:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 136 00000100:00100000:3.0:1788651932.837783:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125527168:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651932.837807:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125527168:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 25us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651932.837814:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 136 00000100:00100000:3.0:1788651932.837837:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125527040 00000100:00100000:3.0:1788651932.837840:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125527040 00000100:00100000:3.0:1788651932.837863:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125527552 00000100:00100000:3.0:1788651932.837866:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125527552 00000100:00100000:3.0:1788651932.837882:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125527424 00000100:00100000:3.0:1788651932.837885:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125527424 00000100:00100000:3.0:1788651932.837899:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 337 00000100:00100000:3.0:1788651932.837905:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125527040:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651932.837955:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125527040:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 50us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651932.837961:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 337 00000100:00100000:3.0:1788651932.837973:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 338 00000100:00100000:3.0:1788651932.837979:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125527552:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651932.838002:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125527552:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 24us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651932.838030:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 338 00000100:00100000:3.0:1788651932.838042:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 339 00000100:00100000:3.0:1788651932.838048:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125527424:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651932.838077:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125527424:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 29us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651932.838081:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 339 00000100:00080000:1.0:1788651932.838356:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788651932.838361:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788651932.838363:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651932.838365:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651932.838863:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125526912 00000100:00100000:2.0:1788651932.838869:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125526912 00000100:00100000:2.0:1788651932.838931:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 394 00000100:00100000:2.0:1788651932.838939:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125526912:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651932.838974:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125526912:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 36us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651932.838980:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 394 00000100:00100000:1.0:1788651932.938468:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651932.938566:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125527808 00000100:00100000:3.0:1788651932.938576:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125527808 00000100:00100000:3.0:1788651932.938649:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 182 00000100:00100000:3.0:1788651932.938663:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12372:x1875537125527808:12345-192.168.204.45@tcp:101:cat.0 00010000:00010000:3.0:1788651932.938690:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651932.938721:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4864 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ea3 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.938858:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c486b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.938882:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c486b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.938895:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c486b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651932.938943:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788651932.939222:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4864 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ea3 expref: 40 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.939389:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c486b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ea3 expref: 39 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.939401:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:3.0:1788651932.939404:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788651932.939407:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906e00, rc 0) 00000100:00100000:3.0:1788651932.939576:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:12372:x1875537125527808:12345-192.168.204.45@tcp:101:cat.0 Request processed in 914us (1116us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1788651932.939583:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 182 00000100:00100000:3.0:1788651932.968066:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651932.968176:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125527936 00000100:00100000:2.0:1788651932.968197:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125527936 00000100:00100000:2.0:1788651932.968287:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 183 00000100:00100000:2.0:1788651932.968298:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:12373:x1875537125527936:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651932.968326:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651932.968351:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4879 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33eaa expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.968501:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4880 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.968516:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4880 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.968528:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4880 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651932.968569:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1788651932.968574:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651932.968591:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4880 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.968616:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4879 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eaa expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.968636:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4880 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eaa expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651932.968646:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651932.968649:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651932.968652:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6e00, rc 0) 00000100:00100000:2.0:1788651932.968719:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12373:x1875537125527936:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 423us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651932.968732:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 183 00000100:00100000:1.0:1788651932.974476:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651932.974567:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125528320 00000100:00100000:0.0:1788651932.974592:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125528320 00000100:00100000:0.0:1788651932.974647:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 48 00000100:00100000:0.0:1788651932.974658:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12373:x1875537125528320:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:0.0:1788651932.975009:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:12373:x1875537125528320:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 352us (544us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788651932.975017:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 48 00000100:00100000:1.0:1788651932.978164:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651932.978280:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125528448 00000100:00100000:3.0:1788651932.978291:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125528448 00000100:00100000:3.0:1788651932.978353:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:3.0:1788651932.978364:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:12373:x1875537125528448:12345-192.168.204.45@tcp:103:lfs.0 00010000:00010000:3.0:1788651932.978390:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788651932.978417:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4810 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e8e expref: 41 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.978444:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c486b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ea3 expref: 40 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.978456:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4706 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e48 expref: 39 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651932.978466:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:3.0:1788651932.978486:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651932.978551:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:12373:x1875537125528448:12345-192.168.204.45@tcp:103:lfs.0 Request processed in 189us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651932.978559:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:1.0:1788651932.984492:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651932.984591:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125528576 00000100:00100000:0.0:1788651932.984604:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125528576 00000100:00100000:0.0:1788651932.984662:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 184 00000100:00100000:0.0:1788651932.984672:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:12373:x1875537125528576:12345-192.168.204.45@tcp:58:lfs.0 00010000:00010000:0.0:1788651932.984941:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4887 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.984959:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4887 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651932.984971:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4887 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788651932.985071:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788651932.985287:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:12373:x1875537125528576:12345-192.168.204.45@tcp:58:lfs.0 Request processed in 615us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651932.985295:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 184 00000100:00100000:1.0:1788651933.008122:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651933.008217:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125528704 00000100:00100000:3.0:1788651933.008228:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125528704 00000100:00100000:3.0:1788651933.008288:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 185 00000100:00100000:3.0:1788651933.008298:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:12375:x1875537125528704:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651933.008318:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651933.008337:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c488e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33eb1 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008411:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4895 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008425:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4895 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008436:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4895 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008449:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c489c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008456:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c489c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008462:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c489c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008530:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008552:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008558:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651933.008596:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788651933.008602:0:10110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788651933.008619:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008630:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008636:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4895 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008642:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4895 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008647:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4895 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008652:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651933.008656:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4895 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008663:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4895 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008675:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:3.0:1788651933.008685:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651933.008703:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4895 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008709:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c4895 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008723:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c489c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008729:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c489c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008735:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c489c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008740:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651933.008742:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c489c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008748:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c489c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008755:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3368200) 00010000:00010000:3.0:1788651933.008757:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651933.008760:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c489c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.008766:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c489c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.009012:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c488e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eb1 expref: 40 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.009039:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eb1 expref: 39 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.009047:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:3.0:1788651933.009049:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788651933.009052:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907400, rc 0) 00000100:00100000:3.0:1788651933.009114:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:12375:x1875537125528704:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 818us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651933.009121:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 185 00010000:00010000:3.0:1788651933.156063:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788651933.409067:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651933.409083:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651933.409129:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788651933.409138:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651933.409270:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a12a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147612672:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788651933.409362:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db240 going to sleep for 11 seconds 00000100:00100000:2.0:1788651933.413267:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a12a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147612672:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788651933.416478:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.416644:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125528832 00000100:00100000:2.0:1788651933.416653:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125528832 00000100:00100000:2.0:1788651933.416710:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 186 00000100:00100000:2.0:1788651933.416721:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:12386:x1875537125528832:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788651933.416749:0:12192:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788651933.416857:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:12386:x1875537125528832:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 137us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651933.418158:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 186 00000100:00100000:1.0:1788651933.423481:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.423588:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125528960 00000100:00100000:2.0:1788651933.423598:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125528960 00000100:00100000:3.0:1788651933.423891:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 187 00000100:00100000:3.0:1788651933.423903:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:12386:x1875537125528960:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788651933.424175:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c48aa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424192:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c48aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424203:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c48aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424219:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424226:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424246:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424270:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48b8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424278:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424284:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651933.424326:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788651933.424330:0:10110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788651933.424343:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424353:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c48aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424359:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c48aa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424364:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c48aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424380:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651933.424385:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c48aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424392:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c48aa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424409:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:3.0:1788651933.424412:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651933.424417:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c48aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424424:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c48aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424435:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424440:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48b1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424445:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424450:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651933.424452:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424457:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48b1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424464:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff8f85c3368200) 00010000:00010000:3.0:1788651933.424466:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651933.424469:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48b1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424474:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424497:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48b8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424504:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48b8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424510:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424515:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651933.424518:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48b8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424525:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48b8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424531:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:3.0:1788651933.424534:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651933.424536:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.424541:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651933.424745:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:12386:x1875537125528960:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 Request processed in 843us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651933.424753:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 187 00000100:00100000:1.0:1788651933.428867:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651933.429136:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125529216 00000100:00100000:0.0:1788651933.429147:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125529216 00000100:00100000:0.0:1788651933.429226:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 188 00000100:00100000:0.0:1788651933.429237:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:12386:x1875537125529216:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651933.429270:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651933.429304:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33eb8 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429440:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429456:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429468:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651933.429491:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788651933.429569:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429579:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48c6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429586:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429593:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651933.429597:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429604:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48c6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429617:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651933.429620:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651933.429636:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48c6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429654:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429703:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48bf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eb8 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429714:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:0.0:1788651933.429716:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651933.429720:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eb8 expref: 41 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.429730:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97600, rc 0) 00000100:00100000:0.0:1788651933.429789:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12386:x1875537125529216:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 554us (1362us total) trans 4294967459 rc 301/301 00000100:00100000:0.0:1788651933.429797:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 188 00000100:00100000:0.0:1788651933.438727:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651933.438799:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125529344 00000100:00100000:3.0:1788651933.438807:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125529344 00000100:00100000:3.0:1788651933.438859:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 189 00000100:00100000:3.0:1788651933.438884:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12386:x1875537125529344:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788651933.438946:0:12192:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788651933.439063:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12386:x1875537125529344:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 181us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651933.439070:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 189 00000100:00100000:1.0:1788651933.443182:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651933.443247:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125529600 00000100:00100000:3.0:1788651933.443256:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125529600 00000100:00100000:3.0:1788651933.443299:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 190 00000100:00100000:3.0:1788651933.443308:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12386:x1875537125529600:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651933.443327:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651933.443330:0:10110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788651933.443354:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4880 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eaa expref: 40 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.443383:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:3.0:1788651933.443388:0:10110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651933.443401:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48d4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ebf expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788651933.443755:0:10110:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788651933.443894:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48db lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.443939:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.443952:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.444023:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c48d4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ebf expref: 42 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.444041:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ebf expref: 41 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.444050:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3368200) 00010000:00010000:3.0:1788651933.444053:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651933.444056:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907c00, rc 0) 00000100:00100000:3.0:1788651933.444114:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:12386:x1875537125529600:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 806us (941us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788651933.444121:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 190 00000100:00100000:1.0:1788651933.452130:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651933.452437:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125529856 00000100:00100000:0.0:1788651933.452451:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125529856 00000100:00100000:0.0:1788651933.452519:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 191 00000100:00100000:0.0:1788651933.452531:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:12386:x1875537125529856:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788651933.452592:0:6510:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651933.452619:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907c00/0xcd2f56ea038c48db lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ebf expref: 41 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453032:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3368200) 00010000:00010000:0.0:1788651933.453048:0:6510:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651933.453085:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48e9 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453108:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453121:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453178:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48f0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x6da53cbc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453186:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6da53cbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453194:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6da53cbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453237:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48e9 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453245:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48e9 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453252:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453258:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651933.453263:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48e9 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453271:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48e9 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453293:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:0.0:1788651933.453296:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651933.453301:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48e9 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453308:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c48e9 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453319:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48f0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x6da53cbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453326:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48f0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6da53cbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453331:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6da53cbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453336:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651933.453340:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48f0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6da53cbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453346:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48f0 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x6da53cbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453354:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x6da53cbc (ffff8f85c3352900) 00010000:00010000:0.0:1788651933.453356:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651933.453359:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48f0 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6da53cbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.453377:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c48f0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x6da53cbc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651933.453473:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12386:x1875537125529856:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 943us (1349us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788651933.453482:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 191 00000100:00100000:3.0:1788651933.456770:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651933.456826:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125529984 00000100:00100000:0.0:1788651933.456842:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125529984 00000100:00100000:0.0:1788651933.456902:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 192 00000100:00100000:0.0:1788651933.456933:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12386:x1875537125529984:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788651933.456952:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651933.456973:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c48f7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ec6 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.457017:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c48fe lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.457031:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c48fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.457044:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c48fe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.457156:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c48f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ec6 expref: 42 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.457173:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c48fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ec6 expref: 41 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.457182:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:0.0:1788651933.457191:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788651933.457195:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97e00, rc 0) 00000100:00100000:0.0:1788651933.457249:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff44aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:12386:x1875537125529984:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 319us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651933.457257:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 192 00000100:00100000:0.0:1788651933.465264:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651933.465504:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125530240 00000100:00100000:1.0:1788651933.465514:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125530240 00000100:00100000:1.0:1788651933.465571:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 193 00000100:00100000:1.0:1788651933.465581:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeaeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:12386:x1875537125530240:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788651933.465663:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.465690:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.465703:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788651933.465869:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788651933.465879:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 389400970407ns, next at 390400968245ns, rc = 0 00000004:00010000:1.0:1788651933.466060:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc506eca reply state 0000000002ea6de8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.466085:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.466101:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:1.0:1788651933.466104:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788651933.466108:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788651933.466206:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeaeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+43:12386:x1875537125530240:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 625us (947us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788651933.466214:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 193 00000100:00100000:0.0:1788651933.469460:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651933.469544:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125530368 00000100:00100000:3.0:1788651933.469554:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125530368 00000100:00100000:3.0:1788651933.469607:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 194 00000100:00100000:3.0:1788651933.469617:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+43:12386:x1875537125530368:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788651933.469640:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651933.469670:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c490c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ecd expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.469749:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c490c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ecd expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.469765:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c490c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ecd expref: 44 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.469799:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:3.0:1788651933.469803:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788651933.469807:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907200, rc 0) 00000100:00100000:3.0:1788651933.469859:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+44:12386:x1875537125530368:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 243us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651933.469866:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 194 00000100:00100000:3.0:1788651933.473651:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651933.473753:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125530496 00000100:00100000:0.0:1788651933.473762:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125530496 00000100:00100000:0.0:1788651933.473819:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:0.0:1788651933.473828:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2388:x1875537125530496:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788651933.474060:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff449880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125530496:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 232us (416us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788651933.474068:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:0.0:1788651933.477515:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.477638:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125530752 00000100:00100000:2.0:1788651933.477650:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125530752 00000100:00100000:2.0:1788651933.477705:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 49 00000100:00100000:2.0:1788651933.477714:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+44:12386:x1875537125530752:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788651933.477994:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+45:12386:x1875537125530752:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 279us (811us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1788651933.478003:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 49 00000100:00100000:3.0:1788651933.480222:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651933.480337:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125531008 00000100:00100000:0.0:1788651933.480346:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125531008 00000100:00100000:0.0:1788651933.480509:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 195 00000100:00100000:0.0:1788651933.480519:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+45:12386:x1875537125531008:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788651933.480611:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+45:12386:x1875537125531008:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 94us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651933.480620:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 195 00000100:00100000:0.0:1788651933.482183:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.482257:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125531136 00000100:00100000:2.0:1788651933.482266:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125531136 00000100:00100000:2.0:1788651933.482387:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 196 00000100:00100000:2.0:1788651933.482396:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+45:12386:x1875537125531136:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651933.482412:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651933.482436:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4913 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ed4 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.482498:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c491a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.482512:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c491a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.482524:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c491a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651933.482569:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651933.482587:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c491a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.482613:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6000/0xcd2f56ea038c4913 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ed4 expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.482630:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c491a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ed4 expref: 46 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.482639:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:2.0:1788651933.482642:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788651933.482646:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6400, rc 0) 00000100:00100000:2.0:1788651933.482695:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+46:12386:x1875537125531136:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 300us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651933.482703:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 196 00000100:00100000:3.0:1788651933.486300:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.486376:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125531264 00000100:00100000:2.0:1788651933.486385:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125531264 00000100:00100000:2.0:1788651933.486470:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 61 00000100:00100000:2.0:1788651933.486480:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125531264:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651933.486495:0:8427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651933.486512:0:8427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4921 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33edb expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651933.486534:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ca99d, blocks: 0x0 00010000:00010000:2.0:1788651933.486551:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=389s v=(0 0) 00010000:00010000:2.0:1788651933.486555:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651933.486564:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4921 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33edb expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.486581:0:8427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4921 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33edb expref: 8 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.486597:0:8427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6a00, rc 0) 00000100:00100000:2.0:1788651933.486656:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125531264:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 178us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651933.486662:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 61 00000100:00100000:0.0:1788651933.490198:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.490283:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125531520 00000100:00100000:2.0:1788651933.490292:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125531520 00000100:00100000:2.0:1788651933.490346:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 197 00000100:00100000:2.0:1788651933.490356:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+46:12386:x1875537125531520:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788651933.490469:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+46:12386:x1875537125531520:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 114us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651933.490476:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 197 00000100:00100000:2.0:1788651933.494564:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.494606:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125531648 00000100:00100000:2.0:1788651933.494615:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125531648 00000100:00100000:2.0:1788651933.494662:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 62 00000100:00100000:2.0:1788651933.494671:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:12386:x1875537125531648:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651933.494687:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651933.494705:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ee2 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.494732:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4921 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33edb expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.494740:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651933.494744:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651933.494749:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.494778:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4921 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33edb expref: 9 pid: 8427 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.494791:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4921 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33edb expref: 9 pid: 8427 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651933.494803:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875537147612800:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651933.494878:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788651933.499204:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.500411:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d58700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875537147612800:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651933.500455:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.500473:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6000, rc 0) 00000100:00100000:2.0:1788651933.500529:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c369c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:12386:x1875537125531648:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 5859us (5975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651933.500537:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 62 00000100:00100000:0.0:1788651933.500625:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125531776 00000100:00100000:0.0:1788651933.500633:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125531776 00010000:00010000:0.0:1788651933.500670:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4921 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33edb expref: 9 pid: 8427 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651933.500705:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 86 00000100:00100000:0.0:1788651933.500713:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2389:x1875537125531776:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651933.500725:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651933.500743:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4921 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33edb expref: 9 pid: 8427 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.500754:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4921 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33edb expref: 9 pid: 8427 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.500774:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4921 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33edb expref: 9 pid: 8427 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.500784:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651933.500788:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651933.500795:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.500804:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.500834:0:6495:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651933.500870:0:6495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6495:1875537147612928:192.168.204.45@tcp:105: 00000100:00100000:0.0:1788651933.500940:0:6495:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788651933.504448:0:6495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6495:1875537147612928:192.168.204.45@tcp:105: 00010000:00010000:0.0:1788651933.504475:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651933.504528:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125531776:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 3815us (5349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651933.504538:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 86 00000100:00100000:2.0:1788651933.511043:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651933.511130:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125531904 00000100:00100000:1.0:1788651933.511140:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125531904 00002000:00100000:1.0:1788651933.511185:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8f85c3d58700 x1875537125531904/t0(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:319/0 lens 504/0 e 0 to 0 dl 1788651944 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788651933.511196:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c3d58700 with x1875537125531904 ext(0->8) 00002000:00010000:1.0:1788651933.511201:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f85c3d58700 00000100:00100000:1.0:1788651933.511258:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:1.0:1788651933.511267:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2390:x1875537125531904:12345-192.168.204.45@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788651933.512227:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:2390:x1875537125531904:12345-192.168.204.45@tcp:4:lhsmtool_posix.0 Request processed in 957us (1190us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788651933.512238:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 5 00002000:00100000:1.0:1788651933.512247:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff8f85c3d58700 x1875537125531904/t4294967315(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:319/0 lens 504/448 e 0 to 0 dl 1788651944 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788651933.512256:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c3d58700 with x1875537125531904 ext(0->8) 00002000:00010000:1.0:1788651933.512260:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f85c3d58700 00000100:00100000:1.0:1788651933.515034:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651933.515231:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125532032 00000100:00100000:0.0:1788651933.515241:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125532032 00000100:00100000:0.0:1788651933.515353:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 198 00000100:00100000:0.0:1788651933.515363:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+46:12386:x1875537125532032:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788651933.518439:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:1.0:1788651933.518466:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788651933.518515:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:2.0:1788651933.518574:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788651933.518587:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:3.0:1788651933.518634:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518646:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518654:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518659:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651933.518664:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518671:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518689:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:3.0:1788651933.518693:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651933.518697:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518711:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4799 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518731:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518736:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518741:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518745:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651933.518748:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518753:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518760:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:3.0:1788651933.518762:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651933.518765:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518770:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c47bc lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518778:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518783:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518795:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518799:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651933.518802:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651933.518803:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:12386:x1875537125532032:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 Request processed in 3437us (3774us total) trans 0 rc 0/0 00010000:00010000:3.0:1788651933.518809:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651933.518813:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 198 00010000:00010000:3.0:1788651933.518816:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:3.0:1788651933.518818:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651933.518820:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518826:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4802 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518836:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518841:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518846:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518850:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651933.518852:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518867:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518876:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:3.0:1788651933.518878:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788651933.518882:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.518888:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4905 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651933.518942:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788651933.518958:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147613056:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788651933.519009:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651933.519739:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147613056 00000100:00100000:3.0:1788651933.519748:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147613056 00000100:00100000:3.0:1788651933.519814:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788651933.519823:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147613056:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788651933.519966:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788651933.519970:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788651933 00002000:00010000:3.0:1788651933.519972:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788651933.519974:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788651933 -> 1788651933 00002000:00010000:3.0:1788651933.519977:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1788651933.520023:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3638:x1875537147613056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 202us (1014us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788651933.520030:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:3.0:1788651933.520076:0:3638:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f86ff51c700/2, rc 0, transno 4294967316 00000100:00100000:3.0:1788651933.520082:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147613056:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788651933.520183:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651933.525200:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651933.525296:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125532160 00000100:00100000:0.0:1788651933.525307:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125532160 00000100:00100000:0.0:1788651933.525375:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 64 00000100:00100000:0.0:1788651933.525386:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:2388:x1875537125532160:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788651933.527690:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1788651933.527706:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788651933.527961:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125532160:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 Request processed in 2572us (2767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651933.527972:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 64 00000100:00100000:0.0:1788651933.530118:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.530635:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125532416 00000100:00100000:2.0:1788651933.530646:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125532416 00000100:00100000:2.0:1788651933.530715:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 199 00000100:00100000:2.0:1788651933.530725:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:12386:x1875537125532416:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788651933.530777:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651933.530804:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c491a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ed4 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.530822:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:2.0:1788651933.530826:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651933.530854:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.530879:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.530888:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651933.531035:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000016eb41d1 reply state 00000000dc93f508 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.531045:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.531051:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:2.0:1788651933.531053:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651933.531056:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651933.531426:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:12386:x1875537125532416:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 700us (1315us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1788651933.531434:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 199 00000100:00100000:3.0:1788651933.534424:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.534559:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125532544 00000100:00100000:2.0:1788651933.534569:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125532544 00000100:00100000:2.0:1788651933.534626:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 65 00000100:00100000:2.0:1788651933.534634:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2391:x1875537125532544:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788651933.534799:0:8428:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788651933.534803:0:8428:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788651933 -> 1788651932 00002000:00010000:2.0:1788651933.534805:0:8428:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788651930 00002000:00010000:2.0:1788651933.534807:0:8428:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788651933 -> 1788651932 00002000:00010000:2.0:1788651933.535271:0:8428:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1788651933.535326:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2391:x1875537125532544:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 691us (911us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1788651933.535347:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 65 00000100:00100000:0.0:1788651933.538549:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651933.538666:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125532800 00000100:00100000:3.0:1788651933.538675:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125532800 00000100:00100000:3.0:1788651933.538732:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 200 00000100:00100000:3.0:1788651933.538741:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:12386:x1875537125532800:12345-192.168.204.45@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788651933.538809:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.538823:0:10110:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c48fe lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ec6 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.538832:0:10110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.538863:0:10110:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c48fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ec6 expref: 20 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651933.538877:0:10110:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c48fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ec6 expref: 20 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651933.538891:0:10110:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147613184:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651933.539001:0:10110:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651933.541868:0:10110:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10110:1875537147613184:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651933.541899:0:10110:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651933.542082:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.542243:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125532928 00000100:00100000:2.0:1788651933.542250:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125532928 00010000:00010000:2.0:1788651933.542286:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c48fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ec6 expref: 21 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651933.542324:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 87 00000100:00100000:2.0:1788651933.542333:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:2389:x1875537125532928:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651933.542345:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651933.542352:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c48fe lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ec6 expref: 21 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.542375:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c48fe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ec6 expref: 21 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.542396:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c48fe lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ec6 expref: 21 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.542410:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:2.0:1788651933.542415:0:7919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.542423:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.542430:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.542465:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651933.542512:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:2389:x1875537125532928:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 180us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651933.542518:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 87 00010000:00010000:2.0:1788651933.543884:0:10110:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.543894:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.543952:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.543961:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.543968:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.543975:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651933.543979:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.543986:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.543999:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:2.0:1788651933.544001:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788651933.544005:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.544026:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906e00/0xcd2f56ea038c4936 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651933.544089:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:12386:x1875537125532800:12345-192.168.204.45@tcp:55:lhsmtool_posix.0 Request processed in 5346us (5547us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788651933.544098:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 200 00000100:00100000:3.0:1788651933.556673:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.556798:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125533056 00000100:00100000:2.0:1788651933.556808:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125533056 00000100:00100000:2.0:1788651933.556881:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 66 00000100:00100000:2.0:1788651933.556891:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2388:x1875537125533056:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788651933.556957:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.556976:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.556984:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651933.556988:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651933.556992:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.557024:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.557036:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 8 pid: 8429 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651933.557068:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875537147613312:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651933.557142:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788651933.563838:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651933.564016:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d5a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875537147613312:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651933.564045:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651933.564187:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125533184 00000100:00100000:0.0:1788651933.564195:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125533184 00010000:00010000:0.0:1788651933.564230:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 9 pid: 8429 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651933.564387:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 88 00000100:00100000:0.0:1788651933.564397:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2389:x1875537125533184:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651933.564411:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651933.564432:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 9 pid: 8429 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.564444:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 9 pid: 8429 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.564591:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d362f5e/0xcd2f56ea038c4928 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee2 expref: 9 pid: 8429 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.564607:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651933.564611:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651933.564617:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.564627:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.564672:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651933.564770:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.564778:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.564798:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.564805:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.564812:0:8429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.564818:0:8429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651933.564822:0:8429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.564830:0:8429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.565080:0:8429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.565089:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062af4c58/0xcd2f56ea038c493d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651933.565164:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2388:x1875537125533056:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 Request processed in 8275us (8502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651933.565184:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 66 00000100:00100000:0.0:1788651933.565357:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c358ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125533184:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 961us (1534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651933.565373:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 88 00000100:00100000:3.0:1788651933.568447:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651933.568544:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125533440 00000100:00100000:0.0:1788651933.568553:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125533440 00000100:00100000:0.0:1788651933.568609:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 201 00000100:00100000:0.0:1788651933.568619:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:12386:x1875537125533440:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788651933.568714:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.568731:0:12192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4792 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e6b expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.568740:0:12192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.568776:0:12192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4792 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e6b expref: 19 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.568790:0:12192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4792 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e6b expref: 19 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651933.568805:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147613440:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651933.568900:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac8900 going to sleep for 11 seconds 00000100:00100000:3.0:1788651933.572383:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.572488:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125533568 00000100:00100000:2.0:1788651933.572496:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125533568 00010000:00010000:2.0:1788651933.572538:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4792 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e6b expref: 20 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651933.572581:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 89 00000100:00100000:2.0:1788651933.572591:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:2388:x1875537125533568:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651933.572606:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651933.572613:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4792 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e6b expref: 20 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.572626:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4792 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e6b expref: 20 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.572648:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651933.572654:0:7919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.572664:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.572672:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.572711:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651933.572757:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:2388:x1875537125533568:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 168us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651933.572764:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 89 00010000:00010000:1.0:1788651933.573425:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4792 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e6b expref: 19 pid: 6509 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651933.573443:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147613440:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651933.573469:0:12192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.573478:0:12192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.573483:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.573699:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.573713:0:12192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c490c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ecd expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.573731:0:12192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.573763:0:12192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c490c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ecd expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.573776:0:12192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c490c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ecd expref: 19 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651933.573789:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a11c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147613568:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651933.573893:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db480 going to sleep for 11 seconds 00000100:00100000:3.0:1788651933.591416:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651933.591592:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a11c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147613568:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651933.591620:0:12192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651933.592381:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125533696 00000100:00100000:2.0:1788651933.592391:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125533696 00010000:00010000:2.0:1788651933.592427:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c490c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ecd expref: 20 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651933.592467:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 90 00000100:00100000:2.0:1788651933.592476:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:2389:x1875537125533696:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651933.592489:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651933.592495:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c490c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ecd expref: 20 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.592506:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c490c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ecd expref: 20 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.592526:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907200/0xcd2f56ea038c490c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ecd expref: 20 pid: 6510 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.592540:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:2.0:1788651933.592545:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.592553:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.592576:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.592638:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651933.592702:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d50380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:2389:x1875537125533696:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 226us (1294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651933.592710:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 90 00010000:00010000:1.0:1788651933.597261:0:12192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.597277:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788651933.597404:0:12192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:1.0:1788651933.597524:0:12192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:1.0:1788651933.597556:0:12192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1788651933.597638:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a11c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12192:1875537147613696:0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788651933.597716:0:12192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651933.597755:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34dba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788651933.597969:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147613696 00000100:00100000:0.0:1788651933.597983:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147613696 00000100:00100000:0.0:1788651933.598051:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788651933.598060:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12192:x1875537147613696:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788651933.598151:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:12192:x1875537147613696:12345-0@lo:1000:mdt00_004.0 Request processed in 91us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651933.598158:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788651933.599312:0:12192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788651933.599322:0:12192:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f86ff51c700, transno 4294967316 00000100:00100000:2.0:1788651933.599380:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a11c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12192:1875537147613696:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788651933.599535:0:12192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788651933.599597:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12192:1875537147613824:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788651933.599650:0:12192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651933.599694:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c12eda80 going to sleep for 11 seconds 00000100:00100000:3.0:1788651933.603517:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147613824 00000100:00100000:3.0:1788651933.603531:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147613824 00000100:00100000:3.0:1788651933.603595:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1788651933.603605:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1395450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:12192:x1875537147613824:12345-0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788651933.603811:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1395450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12192:x1875537147613824:12345-0@lo:1000:mdt00_004.0 Request processed in 207us (4159us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788651933.603819:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788651933.604840:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12192:1875537147613824:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788651933.605057:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.605068:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.605074:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.605079:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651933.605083:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.605105:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.605120:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:2.0:1788651933.605123:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651933.605128:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.605134:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c494b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.605158:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4887 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.605163:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4887 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.605168:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4887 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.605989:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651933.605995:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4887 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.606002:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4887 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.606013:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:2.0:1788651933.606016:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651933.606020:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4887 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.606051:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97800/0xcd2f56ea038c4887 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.606079:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.606094:0:12192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eb1 expref: 22 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.606103:0:12192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.606141:0:12192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eb1 expref: 22 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.606156:0:12192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eb1 expref: 22 pid: 10110 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651933.607151:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147613952:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651933.607419:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9900 going to sleep for 11 seconds 00000100:00100000:0.0:1788651933.616122:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147613952:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651933.616152:0:12192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651933.624850:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651933.625053:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125533824 00000100:00100000:0.0:1788651933.625063:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125533824 00010000:00010000:0.0:1788651933.625103:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eb1 expref: 23 pid: 10110 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651933.625134:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 91 00000100:00100000:0.0:1788651933.625143:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:2389:x1875537125533824:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651933.625157:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651933.625164:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eb1 expref: 23 pid: 10110 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625181:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eb1 expref: 23 pid: 10110 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625200:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c48a3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33eb1 expref: 23 pid: 10110 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625217:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651933.625235:0:7919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625253:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625261:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625291:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651933.625342:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:2389:x1875537125533824:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 199us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651933.625349:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 91 00010000:00010000:0.0:1788651933.625386:0:12192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625393:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625406:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625411:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625417:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625423:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651933.625427:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625444:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625453:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651933.625456:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651933.625459:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625464:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4952 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625473:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625479:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625485:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625492:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651933.625495:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625499:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625506:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651933.625508:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788651933.625511:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.625524:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4944 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651933.625657:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:12386:x1875537125533440:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 57039us (57218us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788651933.625665:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 201 00000020:00080000:0.0:1788651933.625669:0:12192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788651933.625845:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788651933.625849:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788651933.626337:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788651933.626346:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788651933.631419:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651933.631502:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125534080 00000100:00100000:0.0:1788651933.631510:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125534080 00000100:00100000:0.0:1788651933.631566:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 50 00000100:00100000:0.0:1788651933.631575:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:12386:x1875537125534080:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788651933.631847:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788651933.631878:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:0.0:1788651933.631943:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4959 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.631960:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4959 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.631971:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4959 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.631980:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4959 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.631999:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4959 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.632006:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4959 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651933.632129:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788651933.632259:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651933.632266:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4959 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.632273:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651933.632277:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4959 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.632285:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4959 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.632298:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:1.0:1788651933.632301:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788651933.632306:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4959 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.632312:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4959 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651933.632323:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651933.632324:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651933.632326:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651933.632452:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6ed050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:12386:x1875537125534080:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 876us (1209us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788651933.632461:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 50 00000020:00080000:0.0:1788651933.632466:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1788651933.774696:0:14701:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651933.774706:0:14701:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651933.774730:0:14701:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788651933.774738:0:14701:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651933.955533:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.955642:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125534336 00000100:00100000:2.0:1788651933.955651:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125534336 00000100:00100000:2.0:1788651933.955712:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 202 00000100:00100000:2.0:1788651933.955722:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:12396:x1875537125534336:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651933.955747:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651933.955768:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4960 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ee9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.955885:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c4967 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.955900:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c4967 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.955941:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c4967 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651933.956022:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788651933.956125:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4960 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee9 expref: 26 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.956142:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c4967 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee9 expref: 25 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.956150:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651933.956154:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788651933.956157:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7000, rc 0) 00000100:00100000:2.0:1788651933.956210:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:12396:x1875537125534336:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 489us (686us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788651933.956217:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 202 00000100:00100000:2.0:1788651933.962218:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651933.962258:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125534464 00000100:00100000:2.0:1788651933.962268:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125534464 00000100:00100000:2.0:1788651933.962325:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 203 00000100:00100000:2.0:1788651933.962336:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:12396:x1875537125534464:12345-192.168.204.45@tcp:34:lfs.0 00010000:00010000:2.0:1788651933.962444:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4975 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962463:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4975 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962477:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4975 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962492:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c497c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962500:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c497c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962507:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c497c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962598:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4983 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962607:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4983 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962612:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4983 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651933.962662:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4983 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962677:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4975 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962693:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4975 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962701:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4975 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962707:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651933.962711:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4975 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962718:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4975 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962732:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651933.962735:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651933.962740:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4975 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962747:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4975 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962768:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c497c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962774:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c497c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962780:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c497c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962786:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651933.962794:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c497c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962801:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c497c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962809:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f86c3228a00) 00010000:00010000:2.0:1788651933.962812:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651933.962815:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c497c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962820:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c497c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962834:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4983 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962841:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4983 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962847:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4983 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962853:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651933.962855:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4983 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962862:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4983 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962869:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f86c3228d00) 00010000:00010000:2.0:1788651933.962871:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651933.962879:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4983 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651933.962886:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4983 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651933.963067:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:12396:x1875537125534464:12345-192.168.204.45@tcp:34:lfs.0 Request processed in 731us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651933.963075:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 203 00000100:00100000:0.0:1788651934.018100:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.023591:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125534720 00000100:00100000:3.0:1788651934.023613:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125534720 00000100:00100000:3.0:1788651934.023735:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 204 00000100:00100000:3.0:1788651934.023748:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+25:12399:x1875537125534720:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651934.023768:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651934.023790:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c498a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ef0 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.023864:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4991 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.023879:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4991 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.023924:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4991 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.023943:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4998 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.023950:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.023955:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024078:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c499f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024086:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c499f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024093:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c499f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651934.024102:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788651934.024178:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4991 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024186:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4991 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024193:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4991 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024198:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651934.024208:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4991 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024216:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4991 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024227:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:3.0:1788651934.024230:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651934.024235:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4991 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024241:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4991 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024254:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4998 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024261:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4998 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024267:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024272:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651934.024275:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4998 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024280:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4998 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024287:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3368500) 00010000:00010000:3.0:1788651934.024289:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651934.024297:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4998 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024302:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4998 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024342:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c498a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef0 expref: 28 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024370:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c499f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef0 expref: 27 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.024376:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:3.0:1788651934.024379:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651934.024381:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906c00, rc 0) 00000100:00100000:3.0:1788651934.024442:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12399:x1875537125534720:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 699us (6354us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788651934.024449:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 204 00000100:00080000:1.0:1788651934.030695:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651934.031202:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651934.037718:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125534848 00000100:00100000:2.0:1788651934.037733:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125534848 00000100:00100000:2.0:1788651934.037798:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 205 00000100:00100000:2.0:1788651934.037808:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12399:x1875537125534848:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:2.0:1788651934.037873:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c49ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.037891:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c49ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.037904:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c49ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.037967:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c49ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.037975:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c49ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.037982:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c49ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.037988:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651934.038001:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c49ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.038009:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c49ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.038022:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:2.0:1788651934.038026:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651934.038030:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c49ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.038037:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c49ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651934.038118:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12399:x1875537125534848:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 311us (6924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.038125:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 205 00000100:00100000:3.0:1788651934.041274:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651934.042013:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125535104 00000100:00100000:1.0:1788651934.042024:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125535104 00000100:00100000:1.0:1788651934.042085:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 51 00000100:00100000:1.0:1788651934.042095:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12399:x1875537125535104:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:1.0:1788651934.042323:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+28:12399:x1875537125535104:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 229us (1055us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788651934.042364:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 51 00000100:00100000:2.0:1788651934.105593:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651934.105690:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125535360 00000100:00100000:0.0:1788651934.105701:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125535360 00000100:00100000:0.0:1788651934.105758:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 206 00000100:00100000:0.0:1788651934.105768:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+28:11932:x1875537125535360:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788651934.105793:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651934.105814:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c49b4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ef7 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.105959:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.105975:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c499f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef0 expref: 29 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.105984:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.106038:0:6509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c499f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef0 expref: 29 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.106052:0:6509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c499f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef0 expref: 29 pid: 12192 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651934.106067:0:6509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875537147614080:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651934.106167:0:6509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ca857e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651934.109592:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651934.109721:0:6509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6509:1875537147614080:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651934.109747:0:6509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651934.109787:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125535488 00000100:00100000:3.0:1788651934.109797:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125535488 00010000:00010000:3.0:1788651934.109844:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c499f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef0 expref: 30 pid: 12192 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651934.109883:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 92 00000100:00100000:3.0:1788651934.109893:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:2388:x1875537125535488:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651934.109934:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651934.110258:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c499f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef0 expref: 30 pid: 12192 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.110289:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c499f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef0 expref: 30 pid: 12192 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.110314:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c499f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef0 expref: 30 pid: 12192 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.110330:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:3.0:1788651934.110335:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.110344:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.110352:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.110383:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651934.110574:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:2388:x1875537125535488:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 681us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651934.110583:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 92 00010000:00010000:0.0:1788651934.110627:0:6509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.110637:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651934.110656:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788651934.110789:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c49b4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef7 expref: 30 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.110807:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef7 expref: 29 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.110816:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:0.0:1788651934.110819:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788651934.110828:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97a00, rc 0) 00000100:00100000:0.0:1788651934.110856:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:11932:x1875537125535360:12345-192.168.204.45@tcp:101:bash.0 Request processed in 5090us (5275us total) trans 4294967474 rc 0/0 00000100:00100000:0.0:1788651934.110865:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 206 00000100:00100000:1.0:1788651934.115864:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.116053:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125535616 00000100:00100000:3.0:1788651934.116064:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125535616 00000100:00100000:3.0:1788651934.116120:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 207 00000100:00100000:3.0:1788651934.116130:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:11932:x1875537125535616:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:3.0:1788651934.116152:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651934.116173:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c49c9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33efe expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.116220:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c49d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.116234:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c49d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.116247:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c49d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.116365:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c49c9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33efe expref: 31 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.116383:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c49d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33efe expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.116391:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:3.0:1788651934.116394:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788651934.116397:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907600, rc 0) 00000100:00100000:3.0:1788651934.116577:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:11932:x1875537125535616:12345-192.168.204.45@tcp:101:bash.0 Request processed in 448us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651934.116585:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 207 00000100:00100000:0.0:1788651934.123492:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651934.123867:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125535872 00000100:00100000:1.0:1788651934.123878:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125535872 00000100:00100000:1.0:1788651934.123966:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 208 00000100:00100000:1.0:1788651934.123977:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:11932:x1875537125535872:12345-192.168.204.45@tcp:36:bash.0 00010000:00010000:1.0:1788651934.124192:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.124209:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.124222:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788651934.124261:0:10110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788651934.124283:0:10110:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021f49f6b reply state 000000007bbb64b2 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.124296:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.124304:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:1.0:1788651934.124307:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788651934.124310:0:10110:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788651934.124346:0:10110:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788651934.124462:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:11932:x1875537125535872:12345-192.168.204.45@tcp:36:bash.0 Request processed in 486us (982us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788651934.124470:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 208 00000020:00080000:1.0:1788651934.124489:0:10110:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788651934.129136:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651934.129228:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125536000 00000100:00100000:2.0:1788651934.129238:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125536000 00000100:00100000:2.0:1788651934.129295:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 209 00000100:00100000:2.0:1788651934.129305:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+34:11932:x1875537125536000:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651934.129327:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651934.129348:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c49de lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f05 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.129416:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c49de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f05 expref: 35 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.129450:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c49de lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f05 expref: 35 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.129471:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:2.0:1788651934.129474:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651934.129478:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6400, rc 0) 00000100:00100000:2.0:1788651934.129538:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:11932:x1875537125536000:12345-192.168.204.45@tcp:101:bash.0 Request processed in 234us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.129545:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 209 00000100:00100000:2.0:1788651934.132706:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.132839:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125536128 00000100:00100000:3.0:1788651934.132848:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125536128 00000100:00100000:3.0:1788651934.132951:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00100000:3.0:1788651934.132961:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:11932:x1875537125536128:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:3.0:1788651934.132977:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651934.132999:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c49e5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f0c expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788651934.133039:0:8428:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ca99c, atime: 0x6a9ca99a, ctime: 0x6a9ca99c, blocks: 0x8 00010000:00010000:3.0:1788651934.133062:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1788651934.133068:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651934.133076:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c49e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f0c expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.133094:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c49e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f0c expref: 8 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.133107:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907000, rc 0) 00000100:00100000:3.0:1788651934.133157:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:11932:x1875537125536128:12345-192.168.204.45@tcp:101:bash.0 Request processed in 197us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651934.133164:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00080000:1.0:1788651934.133383:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651934.136615:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.136762:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125536256 00000100:00100000:3.0:1788651934.136773:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125536256 00002000:00010000:3.0:1788651934.136815:0:8434:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788651934.136820:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86ff51b100 with x1875537125536256 ext(0->18446744073709551615) 00002000:00010000:3.0:1788651934.136832:0:8434:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f86ff51b100. 00000100:00100000:3.0:1788651934.136863:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:3.0:1788651934.136873:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2390:x1875537125536256:12345-192.168.204.45@tcp:10:bash.0 00002000:00010000:3.0:1788651934.137163:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788651934.137168:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788651932 -> 1788651933 00002000:00010000:3.0:1788651934.137170:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788651930 -> 1788651930 00002000:00010000:3.0:1788651934.137172:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788651932 -> 1788651933 00002000:00010000:3.0:1788651934.137184:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788651934.137246:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2390:x1875537125536256:12345-192.168.204.45@tcp:10:bash.0 Request processed in 374us (639us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788651934.137255:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 6 00002000:00010000:3.0:1788651934.137258:0:8434:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788651934.137261:0:8434:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86ff51b100 with x1875537125536256 ext(0->18446744073709551615) 00002000:00010000:3.0:1788651934.137266:0:8434:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f86ff51b100. 00000100:00100000:1.0:1788651934.176308:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651934.176331:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c2a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147614336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651934.176408:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.176539:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147614336 00000100:00100000:2.0:1788651934.176548:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147614336 00000100:00100000:2.0:1788651934.176604:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788651934.176612:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875537147614336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788651934.176633:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:2.0:1788651934.176690:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3636:x1875537147614336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.176697:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788651934.176743:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c2a10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147614336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651934.176998:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651934.177009:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147614208:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651934.177037:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651934.177252:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147614208 00000100:00100000:3.0:1788651934.177257:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147614208 00000100:00100000:3.0:1788651934.177297:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788651934.177305:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c2a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147614208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788651934.177317:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3691974656 00000100:00100000:3.0:1788651934.177363:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c2a10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147614208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651934.177370:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788651934.177400:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147614208:0@lo:13:osp-pre-1-1.0 00000100:00080000:1.0:1788651934.177522:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651934.178512:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147614720:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.178559:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.178584:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147615232:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.178608:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.178622:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147615744:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.178655:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.178681:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788651934.178687:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147614592:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.178706:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.178720:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147615104:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.178739:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.178759:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147615616:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.178777:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.178799:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147614720 00000100:00100000:2.0:1788651934.178805:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147614720 00000100:00100000:2.0:1788651934.178839:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788651934.178847:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147614720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.178893:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147614720:12345-0@lo:400:kworker.0 Request processed in 46us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.178900:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:2.0:1788651934.178938:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147615232 00000100:00100000:2.0:1788651934.178942:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147615232 00000100:00100000:2.0:1788651934.178965:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147615744 00000100:00100000:2.0:1788651934.178968:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147615744 00000100:00100000:2.0:1788651934.178979:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147614592 00000100:00100000:2.0:1788651934.178981:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147614592 00000100:00100000:2.0:1788651934.178989:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147615104 00000100:00100000:2.0:1788651934.178991:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147615104 00000100:00100000:2.0:1788651934.179002:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147615616 00000100:00100000:2.0:1788651934.179005:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147615616 00000100:00100000:2.0:1788651934.179017:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788651934.179022:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147615232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179049:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147615232:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.179060:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788651934.179072:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788651934.179077:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147615744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179099:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147615744:12345-0@lo:400:kworker.0 Request processed in 23us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.179105:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788651934.179115:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788651934.179121:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147614592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179142:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff4b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147614592:12345-0@lo:400:kworker.0 Request processed in 21us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.179147:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788651934.179156:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788651934.179161:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147615104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179181:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3392680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147615104:12345-0@lo:400:kworker.0 Request processed in 20us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.179187:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788651934.179196:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788651934.179201:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147615616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179222:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3391f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147615616:12345-0@lo:400:kworker.0 Request processed in 21us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.179227:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00080000:2.0:1788651934.179249:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788651934.179252:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788651934.179262:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147614464:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179302:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.179327:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147614976:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179349:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.179379:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147615488:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179402:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.179421:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788651934.179427:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147614848:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179447:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.179461:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147615360:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179478:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.179501:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147614976 00000100:00100000:2.0:1788651934.179505:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147614976 00000100:00100000:2.0:1788651934.179529:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788651934.179535:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c3390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147614976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179567:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c3390380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147614976:12345-0@lo:400:kworker.0 Request processed in 33us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.179573:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788651934.179592:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147615488 00000100:00100000:2.0:1788651934.179596:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147615488 00000100:00100000:2.0:1788651934.179620:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147615360 00000100:00100000:2.0:1788651934.179623:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147615360 00000100:00100000:2.0:1788651934.179640:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788651934.179645:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147615488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179672:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147615488:12345-0@lo:400:kworker.0 Request processed in 27us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.179677:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788651934.179695:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788651934.179700:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147615360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179725:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147615360:12345-0@lo:400:kworker.0 Request processed in 26us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.179731:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1788651934.179748:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651934.179755:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147614848 00000100:00100000:2.0:1788651934.179758:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147614848 00000100:00100000:2.0:1788651934.179776:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788651934.179781:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147614848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179805:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147614848:12345-0@lo:400:kworker.0 Request processed in 25us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.179811:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788651934.179844:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff518000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147614592:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179854:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147615104:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179862:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147615616:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179872:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147614720:0@lo:400:kworker.0 00010000:00080000:2.0:1788651934.179883:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff447800 x1875537147615232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651934.179894:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147615232:0@lo:400:kworker.0 00010000:00080000:2.0:1788651934.179904:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff444000 x1875537147615744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651934.179935:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147615744:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179986:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147614848:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.179994:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147615360:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.180002:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147614976:0@lo:400:kworker.0 00000100:00100000:2.0:1788651934.180011:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147615488:0@lo:400:kworker.0 00000100:00100000:0.0:1788651934.180148:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147614464 00000100:00100000:0.0:1788651934.180152:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147614464 00000100:00100000:0.0:1788651934.180179:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:0.0:1788651934.180185:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147614464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651934.180234:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147614464:12345-0@lo:400:kworker.0 Request processed in 49us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651934.180240:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00010000:00010000:0.0:1788651934.180294:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651934.180945:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147614464:0@lo:400:kworker.0 00000100:00100000:0.0:1788651934.197702:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651934.197797:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125536384 00000100:00100000:2.0:1788651934.197806:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125536384 00000100:00100000:2.0:1788651934.197868:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 210 00000100:00100000:2.0:1788651934.197878:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:12413:x1875537125536384:12345-192.168.204.45@tcp:34:lfs.0 00010000:00010000:2.0:1788651934.198072:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c49ec lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198090:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c49ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198101:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c49ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198116:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c49f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198123:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c49f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198130:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c49f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198212:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c49fa lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198222:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c49fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198229:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c49fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651934.198277:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c49fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198287:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c49ec lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198294:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c49ec lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198302:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c49ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198309:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651934.198314:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c49ec lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198322:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c49ec lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198334:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651934.198337:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651934.198341:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c49ec lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198367:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c49ec lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198381:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c49f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198387:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c49f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198394:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c49f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198399:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651934.198403:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c49f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198409:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c49f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198417:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f86c3228d00) 00010000:00010000:2.0:1788651934.198420:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651934.198423:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c49f3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198428:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c49f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198442:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c49fa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198448:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c49fa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198459:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c49fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198464:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651934.198467:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c49fa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198472:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c49fa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198479:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:2.0:1788651934.198482:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651934.198485:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c49fa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.198491:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c49fa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651934.198606:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:12413:x1875537125536384:12345-192.168.204.45@tcp:34:lfs.0 Request processed in 728us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.198614:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 210 00000100:00100000:2.0:1788651934.234244:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651934.234370:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125536640 00000100:00100000:0.0:1788651934.234381:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125536640 00000100:00100000:0.0:1788651934.234442:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 211 00000100:00100000:0.0:1788651934.234452:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ea15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+35:12416:x1875537125536640:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651934.234473:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651934.234493:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4a01 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f13 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234568:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4a08 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234585:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4a08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234614:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4a08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234630:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4a0f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234638:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4a0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234646:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4a0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234750:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4a16 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234761:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234770:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4a16 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651934.234780:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788651934.234858:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4a08 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234877:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4a08 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234884:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4a08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234890:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651934.234901:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4a08 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234956:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4a08 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234970:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:0.0:1788651934.234973:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651934.234977:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4a08 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234985:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97200/0xcd2f56ea038c4a08 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.234999:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4a0f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.235006:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4a0f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.235012:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4a0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.235018:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651934.235021:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4a0f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.235027:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4a0f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.235035:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3352e00) 00010000:00010000:0.0:1788651934.235038:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651934.235047:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4a0f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.235053:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4a0f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.235098:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4a01 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f13 expref: 38 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.235113:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4a16 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f13 expref: 37 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.235120:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:0.0:1788651934.235122:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788651934.235125:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97600, rc 0) 00000100:00100000:0.0:1788651934.235191:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ea15d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12416:x1875537125536640:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 740us (956us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788651934.235199:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 211 00000100:00100000:0.0:1788651934.238593:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651934.238685:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125536768 00000100:00100000:1.0:1788651934.238694:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125536768 00000100:00100000:1.0:1788651934.238750:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 212 00000100:00100000:1.0:1788651934.238759:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12416:x1875537125536768:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:1.0:1788651934.238822:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.238839:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef7 expref: 37 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.238848:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.238882:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef7 expref: 37 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.238897:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef7 expref: 37 pid: 6509 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651934.238949:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d58000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1875537147615872:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651934.239049:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 11 seconds 00000100:00100000:2.0:1788651934.250765:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651934.250898:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d58000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1875537147615872:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651934.250957:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651934.254007:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125537024 00000100:00100000:3.0:1788651934.254022:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125537024 00000100:00100000:3.0:1788651934.254093:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 52 00000100:00100000:3.0:1788651934.254104:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:10779:x1875537125537024:12345-192.168.204.45@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788651934.254434:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:10779:x1875537125537024:12345-192.168.204.45@tcp:35:ldlm_bl.0 Request processed in 330us (3679us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788651934.254442:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 52 00000100:00100000:2.0:1788651934.257183:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651934.257336:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125537152 00000100:00100000:1.0:1788651934.257346:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125537152 00010000:00010000:1.0:1788651934.257398:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef7 expref: 39 pid: 6509 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651934.257439:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 93 00000100:00100000:1.0:1788651934.257448:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:2388:x1875537125537152:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651934.257462:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651934.257468:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef7 expref: 39 pid: 6509 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.257480:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef7 expref: 39 pid: 6509 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.257502:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c49bb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ef7 expref: 39 pid: 6509 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.257518:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:1.0:1788651934.257522:0:7919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.257532:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.257560:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.257596:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651934.257648:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:2388:x1875537125537152:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 200us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651934.257656:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 93 00010000:00010000:2.0:1788651934.258062:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.258072:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.258122:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.258130:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.258136:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.258143:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651934.258147:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.258155:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.258165:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:2.0:1788651934.258168:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788651934.258171:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.258177:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a24 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651934.258234:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12416:x1875537125536768:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 19475us (19650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.258243:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 212 00000100:00100000:2.0:1788651934.262368:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.262460:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125537408 00000100:00100000:3.0:1788651934.262468:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125537408 00000100:00100000:3.0:1788651934.262652:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:3.0:1788651934.262687:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+37:12416:x1875537125537408:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:3.0:1788651934.263137:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:12416:x1875537125537408:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 451us (787us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788651934.263145:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:1.0:1788651934.373271:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651934.373380:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125537664 00000100:00100000:2.0:1788651934.373389:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125537664 00000100:00100000:2.0:1788651934.373464:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 213 00000100:00100000:2.0:1788651934.373475:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+38:12427:x1875537125537664:12345-192.168.204.45@tcp:101:cat.0 00010000:00010000:2.0:1788651934.373499:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651934.373518:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4a2b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f1a expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373587:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4a32 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373600:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4a32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373611:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4a32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373625:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4a39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373632:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4a39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373639:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4a39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373756:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4a40 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373766:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373773:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4a40 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651934.373793:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788651934.373867:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4a32 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373875:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4a32 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373881:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4a32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373887:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651934.373891:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4a32 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373898:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4a32 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373956:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651934.373959:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651934.373963:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4a32 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373970:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4a32 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373983:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4a39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.373989:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4a39 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.374005:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4a39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.374010:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651934.374027:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4a39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.374034:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4a39 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.374043:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f86c3228d00) 00010000:00010000:2.0:1788651934.374046:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651934.374048:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4a39 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.374054:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4a39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.374094:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4a2b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f1a expref: 41 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.374108:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4a40 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f1a expref: 40 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.374114:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:2.0:1788651934.374116:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651934.374118:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6c00, rc 0) 00000100:00100000:2.0:1788651934.374645:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12427:x1875537125537664:12345-192.168.204.45@tcp:101:cat.0 Request processed in 1170us (1381us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788651934.374673:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 213 00000100:00100000:2.0:1788651934.389426:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.394787:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125537920 00000100:00100000:3.0:1788651934.394805:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125537920 00000100:00100000:3.0:1788651934.394881:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:3.0:1788651934.394891:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+40:12427:x1875537125537920:12345-192.168.204.45@tcp:35:cat.0 00000100:00100000:3.0:1788651934.395802:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:12427:x1875537125537920:12345-192.168.204.45@tcp:35:cat.0 Request processed in 909us (6387us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788651934.395812:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:1.0:1788651934.424872:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.424962:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125538176 00000100:00100000:3.0:1788651934.424972:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125538176 00000100:00100000:3.0:1788651934.425173:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 214 00000100:00100000:3.0:1788651934.425184:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+41:12428:x1875537125538176:12345-192.168.204.45@tcp:36:rm.0 00010000:00010000:3.0:1788651934.425244:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788651934.425271:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c49de lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f05 expref: 41 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425293:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6c00/0xcd2f56ea038c4a40 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f1a expref: 40 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425304:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4a16 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f13 expref: 39 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425316:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c49d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33efe expref: 38 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425340:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:3.0:1788651934.425345:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788651934.425377:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4a4e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425390:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4a4e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425399:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4a4e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425413:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425419:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425425:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425498:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4a5c lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425506:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4a5c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425513:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4a5c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788651934.425712:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:3.0:1788651934.425758:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4a63 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425773:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4a63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425782:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4a63 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425789:0:6511:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4a63 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425794:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4a63 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425800:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4a63 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425824:0:6511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788651934.425841:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4a5c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425847:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4a5c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425853:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4a5c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425859:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651934.425863:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4a5c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425869:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4a5c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425888:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:3.0:1788651934.425891:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788651934.425895:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4a5c lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425900:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4a5c lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425965:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4a4e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425972:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4a4e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425976:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4a4e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425981:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651934.425983:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4a4e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425988:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4a4e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.425995:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:3.0:1788651934.425997:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651934.426000:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4a4e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.426005:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4a4e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.427130:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651934.427140:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4a63 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.427147:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651934.427151:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4a63 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.427169:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4a63 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.427184:0:6498:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:1.0:1788651934.427187:0:6498:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788651934.427191:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4a63 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.427197:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906800/0xcd2f56ea038c4a63 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.427214:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651934.427216:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651934.427230:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:3.0:1788651934.428321:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055248530 reply state 000000002ee0ee91 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.428335:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.428343:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3368d00) 00010000:00010000:3.0:1788651934.428346:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788651934.428360:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788651934.428452:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:12428:x1875537125538176:12345-192.168.204.45@tcp:36:rm.0 Request processed in 3265us (3585us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788651934.428461:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 214 00000100:00100000:2.0:1788651934.562377:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651934.563062:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125538432 00000100:00100000:1.0:1788651934.563073:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125538432 00000100:00100000:1.0:1788651934.563137:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 215 00000100:00100000:1.0:1788651934.563147:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c23aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+39:12434:x1875537125538432:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:1.0:1788651934.563757:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651934.563779:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a6a lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f21 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.563883:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4a71 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.563898:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4a71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.563947:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4a71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.563959:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.563966:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.563972:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788651934.564485:0:6510:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788651934.564626:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4a7f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.564636:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4a7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565108:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4a7f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565150:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4a71 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565369:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4a71 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565376:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4a71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565382:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651934.565386:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4a71 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565394:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4a71 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565408:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:1.0:1788651934.565410:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651934.565415:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4a71 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565421:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415c00/0xcd2f56ea038c4a71 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788651934.565438:0:6510:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000008c16f90 reply state 00000000b398cea9 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565451:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565466:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3368d00) 00010000:00010000:1.0:1788651934.565469:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788651934.565472:0:6510:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788651934.565506:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414e00/0xcd2f56ea038c4a6a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f21 expref: 42 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565521:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4a7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f21 expref: 41 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.565529:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f85c3372f00) 00010000:00010000:1.0:1788651934.565532:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651934.565533:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415000, rc 0) 00000100:00100000:1.0:1788651934.565611:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c23aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+42:12434:x1875537125538432:12345-192.168.204.45@tcp:101:bash.0 Request processed in 2465us (3243us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1788651934.565620:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 215 00000100:00100000:1.0:1788651934.568249:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651934.571098:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125538560 00000100:00100000:2.0:1788651934.571111:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125538560 00000100:00100000:2.0:1788651934.571201:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 68 00000100:00100000:2.0:1788651934.571211:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125538560:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651934.571228:0:8744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788651934.571498:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788651934.571726:0:8744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c4a8d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f28 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651934.571752:0:8744:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788651934.571773:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=390s v=(0 0) 00010000:00010000:2.0:1788651934.571778:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651934.571788:0:8744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c4a8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f28 expref: 6 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.571806:0:8744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c4a8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f28 expref: 6 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.571820:0:8744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7200, rc 0) 00000100:00100000:2.0:1788651934.571886:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125538560:12345-192.168.204.45@tcp:101:bash.0 Request processed in 676us (3658us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.571893:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 68 00000100:00100000:2.0:1788651934.582289:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.582441:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125538688 00000100:00100000:3.0:1788651934.582451:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125538688 00000100:00100000:3.0:1788651934.582506:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:3.0:1788651934.582516:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:12434:x1875537125538688:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:3.0:1788651934.582535:0:8428:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651934.582552:0:8428:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f2f expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.582593:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c4a8d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f28 expref: 7 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.582602:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651934.582606:0:8428:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651934.582612:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.582654:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c4a8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f28 expref: 7 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.582677:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c4a8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f28 expref: 7 pid: 8744 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651934.582690:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875537147616000:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788651934.582781:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651934.585813:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8428:1875537147616000:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651934.585853:0:8428:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 7 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.585877:0:8428:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906c00, rc 0) 00000100:00100000:3.0:1788651934.585971:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:12434:x1875537125538688:12345-192.168.204.45@tcp:101:bash.0 Request processed in 3456us (3691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651934.585981:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:2.0:1788651934.590314:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.590394:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125538816 00000100:00100000:3.0:1788651934.590405:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125538816 00010000:00010000:3.0:1788651934.590447:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c4a8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f28 expref: 7 pid: 8744 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651934.590491:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 94 00000100:00100000:3.0:1788651934.590501:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2390:x1875537125538816:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651934.590533:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651934.590561:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c4a8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f28 expref: 7 pid: 8744 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.590573:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c4a8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f28 expref: 7 pid: 8744 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.590596:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c877259/0xcd2f56ea038c4a8d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f28 expref: 7 pid: 8744 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.590612:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651934.590616:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651934.590624:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.590633:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.590684:0:6497:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651934.590697:0:6497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6497:1875537147616128:192.168.204.45@tcp:105: 00000100:00100000:3.0:1788651934.590774:0:6497:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651934.598762:0:6497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6497:1875537147616128:192.168.204.45@tcp:105: 00010000:00010000:3.0:1788651934.598789:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651934.598869:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2390:x1875537125538816:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 8367us (8563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651934.598880:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 94 00000100:00100000:1.0:1788651934.605707:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.610133:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125539072 00000100:00100000:3.0:1788651934.610149:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125539072 00000100:00100000:3.0:1788651934.610216:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00100000:3.0:1788651934.610227:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+42:12434:x1875537125539072:12345-192.168.204.45@tcp:35:bash.0 00000100:00100000:3.0:1788651934.610744:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+43:12434:x1875537125539072:12345-192.168.204.45@tcp:35:bash.0 Request processed in 517us (5047us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788651934.610753:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00100000:2.0:1788651934.840016:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651934.840134:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125539200 00000100:00100000:0.0:1788651934.840145:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125539200 00000100:00100000:0.0:1788651934.840212:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 216 00000100:00100000:0.0:1788651934.840224:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c1a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+43:12450:x1875537125539200:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651934.840248:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651934.840269:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4a9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f36 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.840382:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4aa2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.840407:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.840419:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651934.840461:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788651934.840465:0:10110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788651934.840626:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4aa2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.840656:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4a9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f36 expref: 45 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.840675:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4aa2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f36 expref: 44 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.840683:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:0.0:1788651934.840686:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651934.840691:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97000, rc 0) 00000100:00100000:0.0:1788651934.840809:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c1a34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+44:12450:x1875537125539200:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 587us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651934.840817:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 216 00000100:00100000:2.0:1788651934.851280:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.851382:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125539456 00000100:00100000:3.0:1788651934.851392:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125539456 00000100:00100000:3.0:1788651934.851451:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 217 00000100:00100000:3.0:1788651934.851461:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+44:12450:x1875537125539456:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651934.851594:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651934.851614:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4aa9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f3d expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.851728:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ab0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.851743:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.851754:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651934.851765:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788651934.851873:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4aa9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f3d expref: 47 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.851891:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f3d expref: 46 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651934.851900:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f85c3372f00) 00010000:00010000:3.0:1788651934.851903:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651934.852037:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907600, rc 0) 00000100:00100000:3.0:1788651934.852099:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+46:12450:x1875537125539456:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 639us (830us total) trans 4294967486 rc 0/0 00000100:00100000:3.0:1788651934.852106:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 217 00000100:00100000:1.0:1788651934.859663:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651934.859714:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651934.860118:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125539584 00000100:00100000:0.0:1788651934.860130:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125539584 00000100:00100000:0.0:1788651934.860201:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:0.0:1788651934.860212:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+46:2388:x1875537125539584:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651934.860228:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651934.860265:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ab0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f3d expref: 46 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.860283:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f85c3372f00) 00010000:00010000:0.0:1788651934.860288:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651934.860578:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+45:2388:x1875537125539584:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 148us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651934.860588:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:2.0:1788651934.863522:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125539840 00000100:00100000:2.0:1788651934.863538:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125539840 00000100:00100000:2.0:1788651934.863615:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 218 00000100:00100000:2.0:1788651934.863625:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+45:12450:x1875537125539840:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651934.863650:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651934.863682:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4abe lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f44 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.863785:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4ac5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.863800:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4ac5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.863812:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4ac5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651934.863825:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788651934.863966:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6600/0xcd2f56ea038c4abe lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f44 expref: 48 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.863984:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4ac5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f44 expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.863994:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f85c3372f00) 00010000:00010000:2.0:1788651934.863996:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788651934.864015:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7200, rc 0) 00000100:00100000:2.0:1788651934.864075:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+47:12450:x1875537125539840:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 452us (4359us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788651934.864082:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 218 00000100:00100000:1.0:1788651934.875584:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651934.875708:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125539968 00000100:00100000:2.0:1788651934.875718:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125539968 00000100:00100000:2.0:1788651934.875777:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 70 00000100:00100000:2.0:1788651934.875789:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+6:2389:x1875537125539968:12345-192.168.204.45@tcp:1:lfs.0 00010000:00010000:2.0:1788651934.875831:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.875851:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.875861:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651934.875866:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651934.875870:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.875939:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 6 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.875955:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 6 pid: 8428 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651934.875976:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1875537147616256:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651934.876061:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9240 going to sleep for 11 seconds 00000100:00100000:2.0:1788651934.878209:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8427:1875537147616256:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651934.878455:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651934.881295:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651934.883606:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125540096 00000100:00100000:2.0:1788651934.883621:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125540096 00002000:00100000:2.0:1788651934.883689:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8f86ff51f800 x1875537125540096/t0(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:320/0 lens 504/0 e 0 to 0 dl 1788651945 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651934.883700:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86ff51f800 with x1875537125540096 ext(0->8) 00010000:00010000:2.0:1788651934.883709:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 7 pid: 8428 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.883725:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 7 pid: 8428 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651934.883734:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f86ff51f800 00000100:00100000:2.0:1788651934.883768:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:2.0:1788651934.883778:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125540096:12345-192.168.204.45@tcp:4:lfs.0 00000100:00100000:2.0:1788651934.887103:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2389:x1875537125540096:12345-192.168.204.45@tcp:4:lfs.0 Request processed in 3316us (5808us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788651934.887117:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 2 00002000:00100000:2.0:1788651934.887130:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff8f86ff51f800 x1875537125540096/t4294967309(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:320/0 lens 504/448 e 0 to 0 dl 1788651945 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651934.887140:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86ff51f800 with x1875537125540096 ext(0->8) 00010000:00010000:2.0:1788651934.887160:0:8432:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 9 pid: 8428 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.887192:0:8432:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 9 pid: 8428 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651934.887201:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8f86ff51f800 00000100:00100000:1.0:1788651934.893217:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651934.893508:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125540224 00000100:00100000:2.0:1788651934.893518:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125540224 00010000:00010000:2.0:1788651934.893556:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 9 pid: 8428 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651934.893597:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 95 00000100:00100000:2.0:1788651934.893606:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2388:x1875537125540224:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651934.893620:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788651934.893637:0:6495:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788651934.893640:0:6495:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788651934 00002000:00010000:2.0:1788651934.893642:0:6495:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788651934 00002000:00010000:2.0:1788651934.893644:0:6495:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788651934 00002000:00010000:2.0:1788651934.893646:0:6495:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788651934.893774:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 9 pid: 8428 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.893791:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 9 pid: 8428 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.893813:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000425e0bc5/0xcd2f56ea038c4a94 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f2f expref: 9 pid: 8428 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.893848:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651934.893853:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651934.893858:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.893867:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.893901:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651934.893995:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2388:x1875537125540224:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 389us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.894003:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 95 00010000:00010000:1.0:1788651934.894254:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.894264:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.894304:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.894312:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.894320:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.894327:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788651934.894332:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.894351:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.894363:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.894370:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062af4c58/0xcd2f56ea038c4ad3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651934.894418:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125539968:12345-192.168.204.45@tcp:1:lfs.0 Request processed in 18631us (18843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651934.894426:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 70 00000100:00100000:0.0:1788651934.902626:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651934.903619:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125540480 00000100:00100000:3.0:1788651934.903633:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125540480 00000100:00100000:3.0:1788651934.903802:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:3.0:1788651934.903813:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+47:12450:x1875537125540480:12345-192.168.204.45@tcp:35:lfs.0 00000004:00010000:3.0:1788651934.903880:0:6512:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4ac5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f44 expref: 47 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651934.904580:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788651934.904618:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788651934.905876:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1788651934.908134:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.908227:0:6512:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4a7f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f21 expref: 51 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.908283:0:6512:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.908417:0:6512:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4a7f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f21 expref: 51 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.908433:0:6512:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4a7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f21 expref: 51 pid: 6510 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651934.908461:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6512:1875537147616384:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651934.908650:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9240 going to sleep for 11 seconds 00000100:00100000:1.0:1788651934.911880:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651934.911967:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125540608 00000100:00100000:0.0:1788651934.911976:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125540608 00010000:00010000:0.0:1788651934.912023:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4a7f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f21 expref: 52 pid: 6510 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651934.912061:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 96 00000100:00100000:0.0:1788651934.912070:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+52:2388:x1875537125540608:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651934.912084:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651934.912090:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4a7f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f21 expref: 52 pid: 6510 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.912104:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4a7f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f21 expref: 52 pid: 6510 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.912126:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f85c3372f00) 00010000:00010000:0.0:1788651934.912131:0:7919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.912142:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.912173:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651934.912192:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651934.912251:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+52:2388:x1875537125540608:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 182us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651934.912258:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 96 00010000:00010000:2.0:1788651934.913743:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415000/0xcd2f56ea038c4a7f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f21 expref: 51 pid: 6510 timeout: 490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651934.913767:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6512:1875537147616384:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651934.913789:0:6512:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.913800:0:6512:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.913806:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651934.913972:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1788651934.914258:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1788651934.914598:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1875537147616512:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788651934.914719:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651934.914818:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb99c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788651934.914862:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147616512 00000100:00100000:3.0:1788651934.914869:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147616512 00000100:00100000:3.0:1788651934.915002:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788651934.915023:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6512:x1875537147616512:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788651934.915141:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6512:x1875537147616512:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 131us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651934.915156:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788651934.915561:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1875537147616512:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788651934.915675:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:1.0:1788651934.915720:0:6512:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1875537147616640:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788651934.915753:0:6512:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651934.915891:0:6512:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788651934.916047:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147616640 00000100:00100000:2.0:1788651934.916053:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147616640 00000100:00100000:2.0:1788651934.916082:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788651934.916089:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6512:x1875537147616640:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788651934.916206:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:6512:x1875537147616640:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 117us (452us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788651934.916229:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788651934.916440:0:6512:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6512:1875537147616640:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788651934.916552:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1788651934.916588:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.916598:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.916605:0:6512:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.916611:0:6512:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651934.916616:0:6512:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.916624:0:6512:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.916639:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f85c3372f00) 00010000:00010000:1.0:1788651934.916642:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788651934.916647:0:6512:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651934.916712:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7600/0xcd2f56ea038c4ada lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788651934.916824:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788651934.916878:0:6512:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788651934.916888:0:6512:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 390851979632ns, next at 391851977809ns, rc = 0 00000001:00080000:1.0:1788651934.916895:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:1.0:1788651934.916944:0:6512:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f85c3372f00) 00010000:00010000:1.0:1788651934.916947:0:6512:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788651934.916955:0:6512:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c4ac5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f44 expref: 55 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651934.917537:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6eec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+54:12450:x1875537125540480:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 13656us (14850us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788651934.917547:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 56 00000020:00080000:1.0:1788651934.917551:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788651934.920519:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651934.920632:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125540736 00000100:00100000:2.0:1788651934.920642:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125540736 00000100:00100000:2.0:1788651934.920700:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 219 00000100:00100000:2.0:1788651934.920709:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+54:12450:x1875537125540736:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651934.920733:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651934.920755:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4ae1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f4b expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.920813:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f4b expref: 55 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.920827:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f4b expref: 55 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651934.920846:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651934.920850:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651934.920853:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6800, rc 0) 00000100:00100000:2.0:1788651934.920957:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+55:12450:x1875537125540736:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 249us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651934.920965:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 219 00000100:00100000:2.0:1788651934.932543:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651934.932637:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125540992 00000100:00100000:1.0:1788651934.932647:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125540992 00000100:00100000:1.0:1788651934.932717:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:1.0:1788651934.932727:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+55:12450:x1875537125540992:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:1.0:1788651934.932985:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+56:12450:x1875537125540992:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 258us (449us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788651934.932999:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:1.0:1788651935.056156:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651935.056228:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125541120 00000100:00100000:3.0:1788651935.056249:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125541120 00000100:00100000:3.0:1788651935.056305:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 220 00000100:00100000:3.0:1788651935.056315:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+56:12460:x1875537125541120:12345-192.168.204.45@tcp:34:lfs.0 00010000:00010000:3.0:1788651935.056397:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4ae8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.056414:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.056425:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.056439:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4aef lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.056447:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4aef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.056454:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4aef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.056545:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4af6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.056554:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.056561:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788651935.056610:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.056631:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4ae8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.056638:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4ae8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.056645:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057123:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651935.057129:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4ae8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057137:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4ae8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057150:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:3.0:1788651935.057153:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651935.057157:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4ae8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057164:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4ae8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057177:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4aef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057183:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4aef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057190:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4aef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057202:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651935.057206:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4aef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057211:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4aef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057218:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3368d00) 00010000:00010000:3.0:1788651935.057220:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651935.057223:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4aef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057228:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4aef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057236:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4af6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057242:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4af6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057248:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4af6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057253:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651935.057255:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4af6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057260:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4af6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057274:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:3.0:1788651935.057276:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651935.057279:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4af6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.057284:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4af6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651935.057377:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+56:12460:x1875537125541120:12345-192.168.204.45@tcp:34:lfs.0 Request processed in 1061us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651935.057386:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 220 00000100:00100000:3.0:1788651935.121025:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.121168:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125541376 00000100:00100000:2.0:1788651935.121179:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125541376 00000100:00100000:2.0:1788651935.121245:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 221 00000100:00100000:2.0:1788651935.121254:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+56:12463:x1875537125541376:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651935.121291:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651935.121313:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4afd lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f52 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121397:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b04 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121412:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121425:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121436:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b0b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121444:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121451:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121569:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121578:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121584:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651935.121594:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788651935.121673:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b04 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121681:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b04 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121687:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121694:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651935.121698:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b04 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121706:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b04 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121717:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651935.121720:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651935.121725:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b04 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121730:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b04 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121741:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b0b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121746:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b0b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121751:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121755:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651935.121764:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b0b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121770:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b0b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121776:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3368d00) 00010000:00010000:2.0:1788651935.121778:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651935.121781:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b0b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121787:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b0b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121824:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4afd lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f52 expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121837:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f52 expref: 58 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.121844:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651935.121846:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651935.121849:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6e00, rc 0) 00000100:00100000:2.0:1788651935.121969:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+58:12463:x1875537125541376:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 715us (954us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788651935.121976:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 221 00000100:00100000:2.0:1788651935.126615:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.129412:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125541504 00000100:00100000:0.0:1788651935.129429:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125541504 00000100:00100000:0.0:1788651935.129691:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 222 00000100:00100000:0.0:1788651935.129703:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1262850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+58:12463:x1875537125541504:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:0.0:1788651935.129776:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.129794:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.129807:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.129844:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.129851:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b20 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.129858:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.129864:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651935.129883:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.129891:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b20 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.129904:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788651935.129926:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788651935.129931:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b20 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.129938:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.130033:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1262850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+58:12463:x1875537125541504:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 332us (3428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.130042:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 222 00000100:00100000:1.0:1788651935.137034:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651935.137187:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125541760 00000100:00100000:3.0:1788651935.137198:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125541760 00000100:00100000:3.0:1788651935.137261:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:3.0:1788651935.137270:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+58:12463:x1875537125541760:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:3.0:1788651935.137530:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+59:12463:x1875537125541760:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 259us (504us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788651935.137539:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 58 00010000:00010000:1.0:1788651935.201883:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651935.202947:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147616768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651935.203020:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651935.203117:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788651935.203123:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147616896:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651935.203164:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651935.203349:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147616768 00000100:00100000:3.0:1788651935.203357:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147616768 00000100:00100000:3.0:1788651935.203409:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147616896 00000100:00100000:3.0:1788651935.203412:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147616896 00000100:00100000:3.0:1788651935.203427:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788651935.203435:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3635:x1875537147616768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651935.203469:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651935.203510:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3635:x1875537147616768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651935.203523:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788651935.204680:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788651935.204693:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147616896:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651935.205097:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147616768:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788651935.205950:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788651935.206044:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147616896:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1353us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651935.206052:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788651935.206123:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147616896:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651935.234033:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.234181:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125542016 00000100:00100000:0.0:1788651935.234192:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125542016 00000100:00100000:0.0:1788651935.234256:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 223 00000100:00100000:0.0:1788651935.234266:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+59:12473:x1875537125542016:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788651935.234290:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651935.234294:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788651935.234319:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4aa2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f36 expref: 59 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.234350:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:0.0:1788651935.234355:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651935.234378:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b27 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f59 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.234513:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.234527:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f52 expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.234534:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.234565:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f52 expref: 59 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.234579:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f52 expref: 59 pid: 6510 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.234593:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147617024:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651935.234802:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c36a39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788651935.238976:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147617024:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651935.239008:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651935.239961:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.240399:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125542144 00000100:00100000:2.0:1788651935.240408:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125542144 00010000:00010000:2.0:1788651935.240447:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f52 expref: 60 pid: 6510 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651935.240501:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 97 00000100:00100000:2.0:1788651935.240511:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+60:2388:x1875537125542144:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651935.240529:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651935.240536:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f52 expref: 60 pid: 6510 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.240548:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f52 expref: 60 pid: 6510 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.240572:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f52 expref: 60 pid: 6510 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.240586:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651935.240591:0:6495:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.240600:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.240607:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.240638:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651935.240705:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+59:2388:x1875537125542144:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 195us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651935.240713:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 97 00010000:00010000:0.0:1788651935.241176:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.241185:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651935.241205:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788651935.241346:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b27 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f59 expref: 60 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.241497:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f59 expref: 59 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.241506:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788651935.241508:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788651935.241511:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96400, rc 0) 00000100:00100000:0.0:1788651935.241589:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+59:12473:x1875537125542016:12345-192.168.204.45@tcp:101:bash.0 Request processed in 7323us (7566us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788651935.241597:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 223 00000100:00100000:3.0:1788651935.245882:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.246027:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125542272 00000100:00100000:0.0:1788651935.246037:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125542272 00000100:00100000:0.0:1788651935.246095:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 224 00000100:00100000:0.0:1788651935.246105:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+59:12473:x1875537125542272:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788651935.246131:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651935.246162:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4b3c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f60 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.246196:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4b43 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.246222:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4b43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.246233:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4b43 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.246372:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4b3c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f60 expref: 61 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.246388:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4b43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f60 expref: 60 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.246397:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788651935.246400:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788651935.246403:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97400, rc 0) 00000100:00100000:0.0:1788651935.247138:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+60:12473:x1875537125542272:12345-192.168.204.45@tcp:101:bash.0 Request processed in 1031us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.247147:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 224 00000100:00100000:1.0:1788651935.250775:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.250949:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125542528 00000100:00100000:0.0:1788651935.250959:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125542528 00000100:00100000:0.0:1788651935.251050:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 225 00000100:00100000:0.0:1788651935.251060:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+60:12473:x1875537125542528:12345-192.168.204.45@tcp:36:bash.0 00010000:00010000:0.0:1788651935.251286:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.251302:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.251313:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788651935.251365:0:6509:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788651935.251387:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e29b9a2 reply state 00000000acba20cb transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.251411:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.251419:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788651935.251422:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788651935.251426:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788651935.251565:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+63:12473:x1875537125542528:12345-192.168.204.45@tcp:36:bash.0 Request processed in 505us (796us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788651935.251572:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 225 00000020:00080000:0.0:1788651935.251577:0:6509:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788651935.254714:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.254787:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125542656 00000100:00100000:2.0:1788651935.254811:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125542656 00000100:00100000:2.0:1788651935.254868:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 226 00000100:00100000:2.0:1788651935.254878:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+63:12473:x1875537125542656:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788651935.254901:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651935.254941:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b51 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f67 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.255029:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.255043:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f59 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.255052:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.255086:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f59 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.255099:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f59 expref: 64 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651935.255111:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147617152:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651935.255543:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788651935.259043:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.259161:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147617152:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651935.259187:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.260112:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125542784 00000100:00100000:0.0:1788651935.260123:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125542784 00010000:00010000:0.0:1788651935.260187:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f59 expref: 65 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.260434:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 98 00000100:00100000:0.0:1788651935.260445:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+65:2388:x1875537125542784:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651935.260461:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651935.260477:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f59 expref: 65 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.260490:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f59 expref: 65 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.260514:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b2e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f59 expref: 65 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.260545:0:7919:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788651935.260550:0:7919:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.260558:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.260566:0:7919:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.260593:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651935.260765:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.260780:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651935.260836:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788651935.260841:0:6511:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651935.260870:0:6511:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.260900:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b51 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f67 expref: 65 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.260934:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f67 expref: 64 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.260940:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651935.260942:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651935.260945:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6400, rc 0) 00000100:00100000:0.0:1788651935.261024:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+64:2388:x1875537125542784:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 580us (1991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.261032:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 98 00000100:00100000:2.0:1788651935.264943:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+63:12473:x1875537125542656:12345-192.168.204.45@tcp:101:bash.0 Request processed in 10053us (10225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651935.264955:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 226 00000100:00100000:0.0:1788651935.273357:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651935.273500:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125543040 00000100:00100000:3.0:1788651935.273511:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125543040 00000100:00100000:3.0:1788651935.273567:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:3.0:1788651935.273577:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+63:12473:x1875537125543040:12345-192.168.204.45@tcp:35:bash.0 00000100:00100000:3.0:1788651935.274017:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+64:12473:x1875537125543040:12345-192.168.204.45@tcp:35:bash.0 Request processed in 440us (671us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788651935.274025:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:1.0:1788651935.357963:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.358178:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125543168 00000100:00100000:0.0:1788651935.358188:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125543168 00000100:00100000:0.0:1788651935.358256:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 227 00000100:00100000:0.0:1788651935.358465:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+64:12479:x1875537125543168:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651935.358488:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651935.358508:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f6e expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.358567:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4b66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.358581:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.358609:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788651935.358659:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1788651935.358662:0:12192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788651935.358679:0:12192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4b66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.358701:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96400/0xcd2f56ea038c4b5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f6e expref: 66 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.358718:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4b66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f6e expref: 65 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.358727:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:0.0:1788651935.358730:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651935.358734:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97000, rc 0) 00000100:00100000:0.0:1788651935.358791:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+65:12479:x1875537125543168:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 527us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.358798:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 227 00000100:00100000:1.0:1788651935.366055:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.366130:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125543296 00000100:00100000:0.0:1788651935.366148:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125543296 00000100:00100000:2.0:1788651935.366313:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 228 00000100:00100000:2.0:1788651935.366326:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+65:12479:x1875537125543296:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651935.366358:0:10110:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651935.366379:0:10110:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b6d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f75 expref: -99 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366442:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b74 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366469:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366480:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366494:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b7b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366501:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366508:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366578:0:10110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4b82 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366587:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366594:0:10110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651935.366636:0:10110:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788651935.366640:0:10110:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651935.366670:0:10110:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366687:0:10110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366706:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b74 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366712:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b74 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366719:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366725:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651935.366729:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b74 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366736:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b74 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366749:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651935.366752:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651935.366758:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b74 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366764:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4b74 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366776:0:10110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b7b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366783:0:10110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b7b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366789:0:10110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366801:0:10110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651935.366804:0:10110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b7b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366810:0:10110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b7b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366818:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3368d00) 00010000:00010000:2.0:1788651935.366820:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651935.366823:0:10110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b7b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366830:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b7b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366856:0:10110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b6d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f75 expref: 67 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366870:0:10110:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4b82 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f75 expref: 66 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.366877:0:10110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651935.366880:0:10110:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651935.366887:0:10110:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6a00, rc 0) 00000100:00100000:2.0:1788651935.367101:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:12479:x1875537125543296:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 777us (1053us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651935.367108:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 228 00000100:00100000:1.0:1788651935.375366:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651935.375444:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651935.375509:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125543680 00000100:00100000:3.0:1788651935.375518:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125543680 00000100:00100000:3.0:1788651935.375584:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:3.0:1788651935.375594:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:2391:x1875537125543680:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651935.375609:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651935.375645:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4b82 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f75 expref: 66 pid: 10110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.375663:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:3.0:1788651935.375668:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651935.375721:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+65:2391:x1875537125543680:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 128us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651935.375729:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:2.0:1788651935.376064:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125543552 00000100:00100000:2.0:1788651935.376075:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125543552 00000100:00100000:2.0:1788651935.376149:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 229 00000100:00100000:2.0:1788651935.376157:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+65:12479:x1875537125543552:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788651935.376173:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651935.376189:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f7c expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.376289:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.376302:0:6511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f67 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.376310:0:6511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.376351:0:6511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f67 expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.376364:0:6511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f67 expref: 66 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651935.376376:0:6511:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147617280:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651935.376449:0:6511:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788651935.379602:0:6511:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6511:1875537147617280:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651935.379630:0:6511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651935.381523:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651935.381760:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125543808 00000100:00100000:3.0:1788651935.381770:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125543808 00010000:00010000:3.0:1788651935.381809:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f67 expref: 67 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651935.381898:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 99 00000100:00100000:3.0:1788651935.381941:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+67:2388:x1875537125543808:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651935.381956:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651935.381963:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f67 expref: 67 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.381975:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f67 expref: 67 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.381996:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4b58 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f67 expref: 67 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.382026:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:3.0:1788651935.382031:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.382054:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.382063:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.382095:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651935.382155:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:2388:x1875537125543808:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 247us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651935.382163:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 99 00010000:00010000:2.0:1788651935.382451:0:6511:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.382466:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651935.382483:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788651935.382604:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4b89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f7c expref: 67 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.382620:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f7c expref: 66 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.382628:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651935.382630:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788651935.382633:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7a00, rc 0) 00000100:00100000:2.0:1788651935.382676:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:12479:x1875537125543552:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 6520us (7320us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788651935.382683:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 229 00000100:00100000:1.0:1788651935.385816:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651935.385895:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125544064 00000100:00100000:3.0:1788651935.385904:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125544064 00000100:00100000:3.0:1788651935.386341:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:3.0:1788651935.386353:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:12479:x1875537125544064:12345-192.168.204.45@tcp:103:lfs.0 00010000:00010000:3.0:1788651935.386368:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651935.386393:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c4ae1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f4b expref: 66 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.386413:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:3.0:1788651935.386418:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651935.386473:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+65:12479:x1875537125544064:12345-192.168.204.45@tcp:103:lfs.0 Request processed in 124us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651935.386481:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:1.0:1788651935.389239:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.389417:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125544192 00000100:00100000:0.0:1788651935.389427:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125544192 00000100:00100000:0.0:1788651935.389485:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 230 00000100:00100000:0.0:1788651935.389494:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+65:12479:x1875537125544192:12345-192.168.204.45@tcp:58:lfs.0 00010000:00010000:0.0:1788651935.389595:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.389627:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.389639:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788651935.389740:0:12192:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788651935.389823:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+65:12479:x1875537125544192:12345-192.168.204.45@tcp:58:lfs.0 Request processed in 330us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.389831:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 230 00000100:00100000:3.0:1788651935.391790:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651935.391966:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125544320 00000100:00100000:1.0:1788651935.391977:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125544320 00000100:00100000:1.0:1788651935.392045:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 231 00000100:00100000:1.0:1788651935.392056:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+65:12479:x1875537125544320:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:1.0:1788651935.392075:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651935.392092:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9200/0xcd2f56ea038c4ba5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f83 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.392155:0:6509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.392166:0:6509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9200/0xcd2f56ea038c4ba5 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f83 expref: 66 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.392184:0:6509:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.392226:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9200/0xcd2f56ea038c4ba5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f83 expref: 66 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.392240:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:1.0:1788651935.392243:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788651935.392247:0:6509:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9200/0xcd2f56ea038c4ba5 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f83 expref: 66 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.392255:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9200, rc 0) 00000100:00100000:1.0:1788651935.392304:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:12479:x1875537125544320:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 251us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651935.392311:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 231 00000040:00080000:0.0:1788651935.712592:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788651935.712604:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788651935.712630:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788651935.712652:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788651935.712813:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147617408:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788651935.712954:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c36a3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788651935.717599:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147617408:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788651935.718246:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.718549:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125544448 00000100:00100000:2.0:1788651935.718557:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125544448 00000100:00100000:2.0:1788651935.718613:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 232 00000100:00100000:2.0:1788651935.718622:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:12481:x1875537125544448:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788651935.718665:0:6511:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788651935.718878:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:12481:x1875537125544448:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 257us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651935.718886:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 232 00000100:00100000:3.0:1788651935.721626:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651935.731934:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125544576 00000100:00100000:1.0:1788651935.731954:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125544576 00000100:00100000:1.0:1788651935.732036:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 233 00000100:00100000:1.0:1788651935.732048:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:12481:x1875537125544576:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788651935.732125:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f8600/0xcd2f56ea038c4bac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.732143:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f8600/0xcd2f56ea038c4bac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.732156:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f8600/0xcd2f56ea038c4bac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.732171:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4bb3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.732193:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.732201:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.732226:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9800/0xcd2f56ea038c4bba lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.732235:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9800/0xcd2f56ea038c4bba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.732241:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9800/0xcd2f56ea038c4bba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651935.732291:0:6509:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788651935.732295:0:6509:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788651935.734502:0:6509:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9800/0xcd2f56ea038c4bba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.734526:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f8600/0xcd2f56ea038c4bac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.734533:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f8600/0xcd2f56ea038c4bac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.734541:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f8600/0xcd2f56ea038c4bac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.734547:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f8600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651935.734551:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f8600/0xcd2f56ea038c4bac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.734575:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f8600/0xcd2f56ea038c4bac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.734591:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:1.0:1788651935.734595:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651935.734600:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f8600/0xcd2f56ea038c4bac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.734606:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f8600/0xcd2f56ea038c4bac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.734622:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.734628:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4bb3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.734633:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.735221:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651935.735225:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.735232:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4bb3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.735241:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff8f85c3372f00) 00010000:00010000:1.0:1788651935.735244:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651935.735247:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4bb3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.735266:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4bb3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.735286:0:6509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9800/0xcd2f56ea038c4bba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.735292:0:6509:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9800/0xcd2f56ea038c4bba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.735298:0:6509:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9800/0xcd2f56ea038c4bba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.735706:0:6509:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651935.735712:0:6509:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9800/0xcd2f56ea038c4bba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.735722:0:6509:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9800/0xcd2f56ea038c4bba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.735733:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:1.0:1788651935.735735:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788651935.735739:0:6509:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9800/0xcd2f56ea038c4bba lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.735745:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9800/0xcd2f56ea038c4bba lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651935.736990:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:12481:x1875537125544576:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 Request processed in 4934us (15364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651935.737002:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 233 00000100:00100000:3.0:1788651935.750199:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651935.750320:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125544832 00000100:00100000:1.0:1788651935.750344:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125544832 00000100:00100000:1.0:1788651935.750395:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 234 00000100:00100000:1.0:1788651935.750405:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+66:12481:x1875537125544832:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651935.750435:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651935.750456:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9c00/0xcd2f56ea038c4bc1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f8a expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750575:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bc8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750591:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750604:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651935.750622:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788651935.750708:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750716:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bc8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750724:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750740:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788651935.750744:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750751:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bc8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750789:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:1.0:1788651935.750793:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788651935.750797:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bc8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750803:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bc8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750846:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9c00/0xcd2f56ea038c4bc1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f8a expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750856:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:1.0:1788651935.750859:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788651935.750863:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9c00/0xcd2f56ea038c4bc1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f8a expref: 68 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.750872:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9c00, rc 0) 00000100:00100000:1.0:1788651935.751210:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+67:12481:x1875537125544832:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 805us (1020us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1788651935.751218:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 234 00000100:00100000:2.0:1788651935.757336:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.757408:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125544960 00000100:00100000:0.0:1788651935.757427:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125544960 00000100:00100000:0.0:1788651935.757488:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 235 00000100:00100000:0.0:1788651935.757498:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+67:12481:x1875537125544960:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788651935.757540:0:12192:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788651935.757744:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+67:12481:x1875537125544960:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 245us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.757752:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 235 00000100:00100000:3.0:1788651935.779618:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651935.781090:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125545216 00000100:00100000:1.0:1788651935.781104:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125545216 00000100:00100000:1.0:1788651935.781359:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 236 00000100:00100000:1.0:1788651935.781371:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+67:12481:x1875537125545216:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651935.781393:0:6509:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651935.781396:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788651935.781420:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97000/0xcd2f56ea038c4b66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f6e expref: 67 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.781455:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:1.0:1788651935.781460:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788651935.781474:0:6509:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9c00/0xcd2f56ea038c4bd6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f91 expref: -99 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788651935.781886:0:6509:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:1.0:1788651935.782090:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bdd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.782103:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.782112:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bdd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.782173:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9c00/0xcd2f56ea038c4bd6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f91 expref: 69 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.782189:0:6509:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bdd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f91 expref: 68 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.782207:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f85c3372f00) 00010000:00010000:1.0:1788651935.782210:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651935.782213:0:6509:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9400, rc 0) 00000100:00100000:1.0:1788651935.782277:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+68:12481:x1875537125545216:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 908us (2669us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788651935.782284:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 236 00000100:00100000:2.0:1788651935.788086:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.788377:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125545472 00000100:00100000:0.0:1788651935.788387:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125545472 00000100:00100000:0.0:1788651935.788488:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 237 00000100:00100000:0.0:1788651935.788513:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+68:12481:x1875537125545472:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788651935.788573:0:6511:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651935.788600:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4bdd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f91 expref: 68 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788620:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f85c3372f00) 00010000:00010000:0.0:1788651935.788631:0:6511:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651935.788666:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4beb lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788681:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4beb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788690:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4beb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788745:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4bf2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xc1a34a9e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788753:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1a34a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788759:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1a34a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788809:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4beb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788816:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4beb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788831:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4beb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788836:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651935.788840:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4beb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788848:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4beb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788856:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:0.0:1788651935.788859:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651935.788863:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4beb lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788869:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96200/0xcd2f56ea038c4beb lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788879:0:6511:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4bf2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1a34a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788884:0:6511:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4bf2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1a34a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788889:0:6511:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1a34a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788894:0:6511:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651935.788896:0:6511:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4bf2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1a34a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788941:0:6511:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4bf2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xc1a34a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788951:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xc1a34a9e (ffff8f85c3352e00) 00010000:00010000:0.0:1788651935.788953:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651935.788956:0:6511:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4bf2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc1a34a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.788962:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97e00/0xcd2f56ea038c4bf2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xc1a34a9e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.789059:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+67:12481:x1875537125545472:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 547us (1157us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788651935.789067:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 237 00000100:00100000:3.0:1788651935.792390:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.797652:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125545600 00000100:00100000:2.0:1788651935.797668:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125545600 00000100:00100000:2.0:1788651935.797749:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 238 00000100:00100000:2.0:1788651935.797760:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+67:12481:x1875537125545600:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651935.797949:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651935.797975:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4bf9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f98 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.798016:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4c00 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.798030:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4c00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.798042:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4c00 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.798163:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4bf9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f98 expref: 69 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.798182:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4c00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f98 expref: 68 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.798190:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:2.0:1788651935.798379:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788651935.798383:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7400, rc 0) 00000100:00100000:2.0:1788651935.798452:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+68:12481:x1875537125545600:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 693us (6074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651935.798467:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 238 00000100:00100000:3.0:1788651935.801333:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.801954:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125545856 00000100:00100000:0.0:1788651935.801967:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125545856 00000100:00100000:0.0:1788651935.802027:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 239 00000100:00100000:0.0:1788651935.802037:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+68:12481:x1875537125545856:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788651935.802144:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.802163:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.802177:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788651935.802974:0:6511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788651935.802987:0:6511:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 391738078725ns, next at 392738076091ns, rc = 0 00000004:00010000:0.0:1788651935.803063:0:6511:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6e3b472 reply state 00000000ca368cef transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.803077:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.803085:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:0.0:1788651935.803088:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788651935.803092:0:6511:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788651935.803672:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+70:12481:x1875537125545856:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 1632us (2363us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788651935.803681:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 239 00000100:00100000:3.0:1788651935.809416:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.809731:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125545984 00000100:00100000:2.0:1788651935.809742:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125545984 00000100:00100000:2.0:1788651935.809871:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 240 00000100:00100000:2.0:1788651935.809882:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+70:12481:x1875537125545984:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651935.809935:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651935.809955:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4c0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33f9f expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.810018:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4c0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f9f expref: 71 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.810033:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4c0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f9f expref: 71 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.810052:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:2.0:1788651935.810055:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651935.810058:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6e00, rc 0) 00000100:00100000:2.0:1788651935.810115:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+71:12481:x1875537125545984:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 236us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651935.810123:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 240 00000100:00100000:0.0:1788651935.816179:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651935.816751:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125546112 00000100:00100000:1.0:1788651935.816761:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125546112 00000100:00100000:1.0:1788651935.816875:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 71 00000100:00100000:1.0:1788651935.816883:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2390:x1875537125546112:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788651935.817112:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:2390:x1875537125546112:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 229us (944us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788651935.817119:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 71 00000100:00100000:0.0:1788651935.821016:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651935.821412:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125546368 00000100:00100000:3.0:1788651935.821424:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125546368 00000100:00100000:3.0:1788651935.821485:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:3.0:1788651935.821496:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+71:12481:x1875537125546368:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788651935.821726:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+72:12481:x1875537125546368:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 231us (721us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788651935.821735:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:2.0:1788651935.830987:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.831418:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125546624 00000100:00100000:0.0:1788651935.831428:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125546624 00000100:00100000:0.0:1788651935.831539:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 241 00000100:00100000:0.0:1788651935.831551:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+72:12481:x1875537125546624:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788651935.831680:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+72:12481:x1875537125546624:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 131us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.831688:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 241 00000100:00100000:1.0:1788651935.838420:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.838512:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125546752 00000100:00100000:2.0:1788651935.838522:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125546752 00000100:00100000:2.0:1788651935.838623:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 242 00000100:00100000:2.0:1788651935.838642:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+72:12481:x1875537125546752:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651935.838681:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651935.838704:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c15 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33fa6 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.838779:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4c1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.838795:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4c1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.838806:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4c1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651935.838847:0:12192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651935.838867:0:12192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4c1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.838892:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c15 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fa6 expref: 74 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.838958:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4c1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fa6 expref: 73 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.838968:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:2.0:1788651935.838971:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788651935.838974:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6400, rc 0) 00000100:00100000:2.0:1788651935.839034:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+73:12481:x1875537125546752:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 403us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651935.839041:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 242 00000040:00080000:0.0:1788651935.841621:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788651935.853389:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651935.854721:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125546880 00000100:00100000:3.0:1788651935.854736:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125546880 00000100:00100000:2.0:1788651935.855046:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 72 00000100:00100000:2.0:1788651935.855058:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+10:2389:x1875537125546880:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651935.855077:0:8744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651935.855098:0:8744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c4c23 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33fad expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788651935.855122:0:8744:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ca99f, blocks: 0x0 00010000:00010000:2.0:1788651935.855153:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=391s v=(0 0) 00010000:00010000:2.0:1788651935.855159:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651935.855169:0:8744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c4c23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fad expref: 11 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.855188:0:8744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c4c23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fad expref: 11 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.855214:0:8744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6200, rc 0) 00000100:00100000:2.0:1788651935.855282:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:2389:x1875537125546880:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 226us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651935.855290:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 72 00000100:00100000:3.0:1788651935.858555:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.858776:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125547136 00000100:00100000:0.0:1788651935.858787:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125547136 00000100:00100000:0.0:1788651935.858845:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 243 00000100:00100000:0.0:1788651935.858855:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+73:12481:x1875537125547136:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788651935.858983:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+73:12481:x1875537125547136:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 129us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.859005:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 243 00000100:00100000:0.0:1788651935.862425:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.862555:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125547264 00000100:00100000:2.0:1788651935.862566:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125547264 00000100:00100000:2.0:1788651935.862625:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 73 00000100:00100000:2.0:1788651935.862635:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:12481:x1875537125547264:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788651935.862663:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651935.862680:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33fb4 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.862731:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c4c23 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fad expref: 12 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.862740:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651935.862744:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788651935.862750:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.862795:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c4c23 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fad expref: 12 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.862810:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c4c23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fad expref: 12 pid: 8744 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651935.862825:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875537147617536:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651935.862941:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788651935.866598:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651935.866746:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125547392 00000100:00100000:1.0:1788651935.866756:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125547392 00010000:00010000:1.0:1788651935.866807:0:7919:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c4c23 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fad expref: 13 pid: 8744 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651935.866849:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 100 00000100:00100000:1.0:1788651935.866860:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:2388:x1875537125547392:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651935.866875:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651935.866896:0:7919:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c4c23 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fad expref: 13 pid: 8744 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.866948:0:7919:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c4c23 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fad expref: 13 pid: 8744 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.866974:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651935.866978:0:7919:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651935.866987:0:7919:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.867027:0:7919:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.867065:0:7919:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 13 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651935.867078:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7919:1875537147617664:192.168.204.45@tcp:105: 00000100:00100000:1.0:1788651935.867155:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34dba80 going to sleep for 11 seconds 00010000:00010000:2.0:1788651935.868077:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f0396ec/0xcd2f56ea038c4c23 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fad expref: 13 pid: 8744 timeout: 491 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651935.868096:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8429:1875537147617536:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651935.868123:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 12 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.868134:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6a00, rc 0) 00000100:00100000:2.0:1788651935.868206:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+12:12481:x1875537125547264:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 5573us (5792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651935.868214:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 73 00000100:00100000:0.0:1788651935.874618:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651935.874783:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7919:1875537147617664:192.168.204.45@tcp:105: 00010000:00010000:1.0:1788651935.874807:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651935.874864:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:2388:x1875537125547392:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 8005us (8275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651935.874875:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 100 00000100:00100000:2.0:1788651935.874968:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125547520 00000100:00100000:2.0:1788651935.874974:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125547520 00002000:00100000:2.0:1788651935.875018:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8f86ff446680 x1875537125547520/t0(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:321/0 lens 504/0 e 0 to 0 dl 1788651946 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651935.875030:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86ff446680 with x1875537125547520 ext(0->12) 00002000:00010000:2.0:1788651935.875035:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f86ff446680 00000100:00100000:2.0:1788651935.875063:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:2.0:1788651935.875073:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+11:2389:x1875537125547520:12345-192.168.204.45@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788651935.876133:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:2389:x1875537125547520:12345-192.168.204.45@tcp:4:lhsmtool_posix.0 Request processed in 1056us (1521us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788651935.876144:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00002000:00100000:2.0:1788651935.876153:0:8433:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff8f86ff446680 x1875537125547520/t4294967321(0) o4->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:321/0 lens 504/448 e 0 to 0 dl 1788651946 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651935.876162:0:8433:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f86ff446680 with x1875537125547520 ext(0->12) 00002000:00010000:2.0:1788651935.876167:0:8433:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f86ff446680 00000100:00100000:0.0:1788651935.879131:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.879223:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125547648 00000100:00100000:2.0:1788651935.879233:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125547648 00000100:00100000:2.0:1788651935.879287:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 244 00000100:00100000:2.0:1788651935.879296:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+73:12481:x1875537125547648:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788651935.881512:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:1.0:1788651935.881534:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1788651935.881573:0:6489:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788651935.881597:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f85c34db780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788651935.881601:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c5a1c900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f85c34db300 00000020:00080000:1.0:1788651935.881604:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86c5a1c000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f86d98e8c00 00010000:00010000:0.0:1788651935.881666:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881681:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881689:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881695:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651935.881701:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881710:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881727:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff8f85c3352300) 00010000:00010000:0.0:1788651935.881730:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651935.881735:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881740:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7800/0xcd2f56ea038c492f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881770:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881798:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881804:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881808:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651935.881810:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881815:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881825:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff8f85c3368100) 00010000:00010000:0.0:1788651935.881826:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651935.881829:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881836:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415800/0xcd2f56ea038c49d7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10110 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881857:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881864:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881871:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881876:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651935.881887:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881894:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788651935.881902:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f86c7e43a80 refcount 2 committed 0 result 0 batchid 6 00010000:00010000:0.0:1788651935.881904:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3368d00) 00000020:00080000:1.0:1788651935.881931:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86ff4bed00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f86c7e43480 00000020:00080000:1.0:1788651935.881935:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86ff4bec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f85c353f200 00010000:00010000:0.0:1788651935.881950:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651935.881955:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881961:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906000/0xcd2f56ea038c4a55 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881975:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881982:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881988:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.881994:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651935.881997:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882003:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882011:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3368d00) 00010000:00010000:0.0:1788651935.882013:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651935.882024:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882031:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414800/0xcd2f56ea038c4a78 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882049:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882055:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882060:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882065:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651935.882067:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882073:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882080:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788651935.882082:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651935.882086:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882091:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4b4a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882100:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882105:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882117:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882121:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651935.882124:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882129:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882136:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:0.0:1788651935.882138:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788651935.882140:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.882145:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96800/0xcd2f56ea038c4c07 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.882172:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147617792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788651935.882239:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651935.882289:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147617792 00000100:00100000:1.0:1788651935.882379:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147617792 00000100:00100000:1.0:1788651935.882469:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788651935.882478:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3637:x1875537147617792:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788651935.882505:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:1.0:1788651935.882534:0:8427:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ca99e, atime: 0x6a9ca99e, ctime: 0x6a9ca99e, blocks: 0x8 00010000:00010000:1.0:1788651935.882541:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018ea29e4/0xcd2f56ea038c4c31 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.882556:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:1.0:1788651935.882560:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788651935.882565:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000018ea29e4/0xcd2f56ea038c4c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.882581:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000018ea29e4/0xcd2f56ea038c4c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.882591:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000018ea29e4/0xcd2f56ea038c4c31 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.882599:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000018ea29e4/0xcd2f56ea038c4c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788651935.882600:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00010000:00010000:1.0:1788651935.882619:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651935.882743:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651935.882751:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000018ea29e4/0xcd2f56ea038c4c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651935.882762:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3637:x1875537147617792:12345-0@lo:6:osp-syn-0-0.0 Request processed in 283us (521us total) trans 4294967311 rc 0/0 00010000:00010000:0.0:1788651935.882763:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788651935.882768:0:7452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000018ea29e4/0xcd2f56ea038c4c31 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788651935.882845:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788651935.882865:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147618048:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788651935.882901:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651935.882954:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:0.0:1788651935.883023:0:7452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000018ea29e4/0xcd2f56ea038c4c31 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.883037:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000018ea29e4/0xcd2f56ea038c4c31 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.883046:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018ea29e4/0xcd2f56ea038c4c31 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.883064:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651935.883066:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651935.883068:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788651935.883099:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f85c3d51180/2, rc 0, transno 4294967311 00000100:00100000:0.0:1788651935.883105:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147617792:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788651935.883114:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788651935.883119:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147617920:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788651935.883145:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651935.889539:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147618048 00000100:00100000:1.0:1788651935.889572:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147618048 00000100:00100000:1.0:1788651935.889622:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147617920 00000100:00100000:1.0:1788651935.889626:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147617920 00000100:00100000:1.0:1788651935.889660:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788651935.889670:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fceff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3635:x1875537147618048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788651935.890722:0:8427:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788651935.890728:0:8427:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788651935 00002000:00010000:1.0:1788651935.890731:0:8427:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788651935.890733:0:8427:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788651935 -> 1788651935 00002000:00010000:1.0:1788651935.890735:0:8427:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:1.0:1788651935.891804:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fceff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3635:x1875537147618048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2128us (8895us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1788651935.891816:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788651935.892009:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788651935.892022:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3637:x1875537147617920:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788651935.892049:0:8427:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:1.0:1788651935.892069:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.892089:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c49e5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f0c expref: 12 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.892097:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788651935.892102:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788651935.892107:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.892142:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c49e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f0c expref: 12 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.892168:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c49e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f0c expref: 12 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651935.892183:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875537147618176:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651935.892266:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34dbe40 going to sleep for 11 seconds 00000100:00080000:1.0:1788651935.892285:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788651935.892298:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f85c3cbdf80/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788651935.892308:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147618048:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788651935.893062:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:12481:x1875537125547648:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 Request processed in 13764us (13936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.893072:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 244 00000100:00100000:0.0:1788651935.901693:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.901731:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.901939:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125547904 00000100:00100000:0.0:1788651935.901949:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125547904 00000100:00100000:0.0:1788651935.902000:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 77 00000100:00100000:0.0:1788651935.902010:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:2388:x1875537125547904:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788651935.902463:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875537147618176:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651935.902490:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.902970:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125547776 00000100:00100000:0.0:1788651935.902975:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125547776 00010000:00010000:0.0:1788651935.903001:0:6495:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c49e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f0c expref: 14 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.903048:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 101 00000100:00100000:0.0:1788651935.903058:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+14:2388:x1875537125547776:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651935.903070:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651935.903075:0:6495:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c49e5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f0c expref: 14 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.903090:0:6495:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c49e5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f0c expref: 14 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.903112:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c49e5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f0c expref: 14 pid: 8428 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.904110:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651935.904117:0:6495:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651935.904124:0:6495:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.904437:0:6495:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.904695:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788651935.904853:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.904865:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.904876:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.904885:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.904931:0:8427:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788651935.905085:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+13:2388:x1875537125547776:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 2026us (3401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651935.905095:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 101 00010000:00010000:2.0:1788651935.905652:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788651935.905661:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.905671:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f8600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788651935.905677:0:6498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.905689:0:6498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.905708:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.905716:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3637:x1875537147617920:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13696us (22567us total) trans 4294967323 rc 0/0 00010000:00010000:2.0:1788651935.905718:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f09f8b0d/0xcd2f56ea038c4c38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.905732:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1788651935.905755:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651935.905759:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651935.905761:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788651935.905885:0:3637:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f85c3cbed80/2, rc 0, transno 4294967323 00000100:00100000:3.0:1788651935.905893:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147617920:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788651935.907583:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:1.0:1788651935.907598:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1788651935.908112:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125547904:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 Request processed in 6098us (6374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.908123:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 77 00000100:00100000:0.0:1788651935.911111:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.911177:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125548160 00000100:00100000:2.0:1788651935.911188:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125548160 00000100:00100000:2.0:1788651935.911247:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 245 00000100:00100000:2.0:1788651935.911258:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:12481:x1875537125548160:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788651935.911312:0:6509:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651935.911361:0:6509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c4c1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fa6 expref: 21 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.911379:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:2.0:1788651935.911384:0:6509:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788651935.911417:0:6509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.911433:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.911445:0:6509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788651935.911584:0:6509:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052e1cafa reply state 00000000b2eeebfc transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.911596:0:6509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.911601:0:6509:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:2.0:1788651935.911604:0:6509:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788651935.911606:0:6509:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788651935.911701:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:12481:x1875537125548160:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 444us (601us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788651935.911708:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 245 00000100:00100000:1.0:1788651935.916037:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651935.916341:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125548288 00000100:00100000:3.0:1788651935.916350:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125548288 00000100:00100000:3.0:1788651935.916407:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 78 00000100:00100000:3.0:1788651935.916417:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125548288:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788651935.916566:0:8744:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788651935.916570:0:8744:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788651935 -> 1788651934 00002000:00010000:3.0:1788651935.916573:0:8744:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788651934 00002000:00010000:3.0:1788651935.916575:0:8744:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788651935 -> 1788651934 00002000:00010000:3.0:1788651935.916577:0:8744:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788651935.916658:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125548288:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 242us (632us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788651935.916683:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 78 00000100:00100000:3.0:1788651935.921143:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651935.921331:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125548544 00000100:00100000:1.0:1788651935.921342:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125548544 00000100:00100000:1.0:1788651935.921403:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 246 00000100:00100000:1.0:1788651935.921414:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:12481:x1875537125548544:12345-192.168.204.45@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788651935.921487:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.921505:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4c00 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f98 expref: 22 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.921531:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.921567:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4c00 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f98 expref: 22 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.921581:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4c00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f98 expref: 22 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651935.921609:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1875537147618304:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651935.921704:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34dbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788651935.941756:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.941942:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125548672 00000100:00100000:0.0:1788651935.941952:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125548672 00010000:00010000:0.0:1788651935.942007:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4c00 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f98 expref: 23 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.942036:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 102 00000100:00100000:0.0:1788651935.942045:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:2388:x1875537125548672:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651935.942059:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651935.942067:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4c00 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f98 expref: 23 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.942080:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4c00 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f98 expref: 23 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.942102:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:0.0:1788651935.942108:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.942119:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.942127:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.942160:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651935.942233:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+23:2388:x1875537125548672:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 189us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.942240:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 102 00010000:00010000:3.0:1788651935.942461:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7400/0xcd2f56ea038c4c00 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f98 expref: 22 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651935.942481:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1875537147618304:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788651935.942503:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.942512:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.942518:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.942557:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.942565:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.942572:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.942578:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651935.942583:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.942591:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.942609:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:3.0:1788651935.942612:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788651935.942617:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.942624:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9e00/0xcd2f56ea038c4c46 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651935.942681:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:12481:x1875537125548544:12345-192.168.204.45@tcp:55:lhsmtool_posix.0 Request processed in 21269us (21562us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788651935.942689:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 246 00000100:00100000:1.0:1788651935.945100:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.945294:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125548800 00000100:00100000:0.0:1788651935.945313:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125548800 00000100:00100000:0.0:1788651935.945383:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 79 00000100:00100000:0.0:1788651935.945407:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125548800:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788651935.945450:0:8427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.945468:0:8427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.945476:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788651935.945480:0:8427:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788651935.945484:0:8427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.945517:0:8427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.945531:0:8427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 8 pid: 8429 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.945545:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875537147618432:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651935.945622:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c36a3180 going to sleep for 11 seconds 00000100:00100000:0.0:1788651935.953022:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8427:1875537147618432:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651935.953056:0:8427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651935.955526:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651935.956260:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125548928 00000100:00100000:2.0:1788651935.956272:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125548928 00010000:00010000:2.0:1788651935.956332:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 9 pid: 8429 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651935.956400:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 103 00000100:00100000:2.0:1788651935.956411:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+9:2389:x1875537125548928:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651935.956427:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651935.956452:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 9 pid: 8429 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.956467:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 9 pid: 8429 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.956492:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c4c2a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fb4 expref: 9 pid: 8429 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.956512:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651935.956517:0:6497:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788651935.956523:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.956534:0:6497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.956571:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651935.956630:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2389:x1875537125548928:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 220us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651935.956638:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 103 00010000:00010000:0.0:1788651935.956836:0:8427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.956853:0:8427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.956874:0:8427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.956884:0:8427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.956893:0:8427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.956901:0:8427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788651935.956944:0:8427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.956955:0:8427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.956967:0:8427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.956975:0:8427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d49d9cad/0xcd2f56ea038c4c4d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.957036:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125548800:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 Request processed in 11631us (11943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.957044:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 79 00000100:00100000:2.0:1788651935.970007:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651935.970121:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125549184 00000100:00100000:1.0:1788651935.970132:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125549184 00000100:00100000:1.0:1788651935.970193:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 247 00000100:00100000:1.0:1788651935.970202:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:12481:x1875537125549184:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788651935.970280:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.970307:0:12192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4b43 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f60 expref: 21 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.970327:0:12192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.970382:0:12192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4b43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f60 expref: 21 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651935.970397:0:12192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4b43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f60 expref: 21 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651935.970410:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147618560:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788651935.970492:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788651935.972985:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147618560:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788651935.973015:0:12192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651935.984120:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651935.984366:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125549312 00000100:00100000:0.0:1788651935.984378:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125549312 00010000:00010000:0.0:1788651935.984424:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4b43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f60 expref: 22 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651935.984468:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 104 00000100:00100000:0.0:1788651935.984479:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:2389:x1875537125549312:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651935.984496:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651935.984504:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4b43 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f60 expref: 22 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.984518:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4b43 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f60 expref: 22 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.984541:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4b43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f60 expref: 22 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.984558:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788651935.984565:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9200/0xcd2f56ea038c4ba5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f83 expref: 21 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.984575:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.984599:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.984607:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651935.984647:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651935.984712:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:2389:x1875537125549312:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 234us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.984719:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 104 00010000:00010000:2.0:1788651935.984894:0:12192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.984903:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.985101:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.985114:0:12192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4c0e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f9f expref: 21 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.985121:0:12192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.985153:0:12192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4c0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f9f expref: 21 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.985167:0:12192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4c0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f9f expref: 21 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651935.985180:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147618688:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788651935.985252:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788651935.993508:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147618688:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788651935.993543:0:12192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651935.995145:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651935.995523:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125549440 00000100:00100000:3.0:1788651935.995533:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125549440 00010000:00010000:3.0:1788651935.995574:0:6497:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4c0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f9f expref: 22 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651935.995673:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 105 00000100:00100000:3.0:1788651935.995683:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:2388:x1875537125549440:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651935.995698:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651935.995706:0:6497:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4c0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f9f expref: 22 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.995721:0:6497:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4c0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f9f expref: 22 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.995744:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4c0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f9f expref: 22 pid: 12192 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.995784:0:6497:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:3.0:1788651935.995790:0:6497:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.995799:0:6497:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.995807:0:6497:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651935.995838:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651935.995895:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:2388:x1875537125549440:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 213us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651935.995903:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 105 00010000:00010000:2.0:1788651935.998847:0:12192:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651935.998865:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788651935.999020:0:12192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788651935.999129:0:12192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:2.0:1788651935.999162:0:12192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788651935.999242:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12192:1875537147618816:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788651935.999307:0:12192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651935.999355:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788651935.999483:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147618816 00000100:00100000:0.0:1788651935.999491:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147618816 00000100:00100000:0.0:1788651935.999549:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788651935.999558:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12192:x1875537147618816:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788651935.999649:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12192:x1875537147618816:12345-0@lo:1000:mdt00_004.0 Request processed in 81us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651935.999657:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788651936.000088:0:12192:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788651936.000095:0:12192:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788651936.000114:0:12192:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f85c3cbdf80, transno 4294967322 00000100:00100000:2.0:1788651936.000127:0:12192:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8f85c3cbed80 x1875537147617920/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788651951 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651936.000138:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12192:1875537147618816:0@lo:1000:mdt00_004.0 00000001:00080000:2.0:1788651936.000260:0:12192:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:2.0:1788651936.000328:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12192:1875537147618944:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788651936.000362:0:12192:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651936.000379:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bb9540 going to sleep for 11 seconds 00000100:00100000:0.0:1788651936.000597:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147618944 00000100:00100000:0.0:1788651936.000602:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147618944 00000100:00100000:0.0:1788651936.000645:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788651936.000654:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:12192:x1875537147618944:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788651936.000752:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:12192:x1875537147618944:12345-0@lo:1000:mdt00_004.0 Request processed in 99us (389us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788651936.000761:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788651936.001492:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbf100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12192:1875537147618944:0@lo:1000:mdt00_004.0 00010000:00010000:2.0:1788651936.001543:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001555:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001584:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001591:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651936.001596:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001606:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001624:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:2.0:1788651936.001628:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651936.001646:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001654:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6a00/0xcd2f56ea038c4c5b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001683:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001691:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001697:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001703:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788651936.001706:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001727:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001736:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651936.001739:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651936.001746:0:12192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9200/0xcd2f56ea038c4ba5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f83 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001758:0:12192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9200/0xcd2f56ea038c4ba5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f83 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001880:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9200/0xcd2f56ea038c4ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f83 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651936.001941:0:12192:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9200/0xcd2f56ea038c4ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f83 expref: 24 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651936.001957:0:12192:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147619072:192.168.204.45@tcp:105: 00000100:00100000:2.0:1788651936.002032:0:12192:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c7e43480 going to sleep for 11 seconds 00000100:00100000:0.0:1788651936.005871:0:12192:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbe300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12192:1875537147619072:192.168.204.45@tcp:105: 00010000:00010000:0.0:1788651936.006030:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006058:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96e00/0xcd2f56ea038c4b9e lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006095:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c62 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006109:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006121:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006131:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c62 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006139:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c62 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006146:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006151:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651936.006155:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c62 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006163:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c62 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006174:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788651936.006177:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788651936.006181:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c62 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006296:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c62 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006387:0:12192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006394:0:12192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006400:0:12192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006405:0:12192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788651936.006408:0:12192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006414:0:12192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006423:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788651936.006425:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788651936.006428:0:12192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.006435:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9000/0xcd2f56ea038c4c54 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651936.006649:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:12481:x1875537125549184:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 36446us (36650us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788651936.006661:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 247 00000020:00080000:0.0:1788651936.006674:0:12192:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788651936.009138:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651936.010132:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125549568 00000100:00100000:1.0:1788651936.010144:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125549568 00000100:00100000:1.0:1788651936.010229:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 61 00000100:00100000:1.0:1788651936.010240:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:12479:x1875537125549568:12345-192.168.204.45@tcp:49:lfs.0 00000100:00100000:1.0:1788651936.010535:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:12479:x1875537125549568:12345-192.168.204.45@tcp:49:lfs.0 Request processed in 296us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651936.010543:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 61 00000100:00080000:3.0:1788651936.010697:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788651936.012048:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651936.012057:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651936.012077:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788651936.012084:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788651936.016031:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651936.016085:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651936.016172:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125549824 00000100:00100000:0.0:1788651936.016183:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125549824 00000100:00100000:0.0:1788651936.016249:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 62 00000100:00100000:0.0:1788651936.016260:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+24:12481:x1875537125549824:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788651936.016567:0:6512:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788651936.016600:0:6512:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:0.0:1788651936.016633:0:6512:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c69 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.016649:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.016660:0:6512:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c69 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.016667:0:6512:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c69 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.016673:0:6512:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c69 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.016678:0:6512:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c69 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.016704:0:6512:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788651936.016794:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6eb050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+26:12481:x1875537125549824:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 535us (708us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788651936.016801:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 62 00000020:00080000:0.0:1788651936.016805:0:6512:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788651936.017212:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651936.017219:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c69 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.017227:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788651936.017231:0:6499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c69 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.017241:0:6499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c69 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.017271:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:3.0:1788651936.017273:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788651936.017278:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c69 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.017284:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96a00/0xcd2f56ea038c4c69 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6512 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.017308:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651936.017310:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651936.017312:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651936.017520:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125550080 00000100:00100000:2.0:1788651936.017527:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125550080 00000100:00100000:2.0:1788651936.017577:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 248 00000100:00100000:2.0:1788651936.017586:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+26:12479:x1875537125550080:12345-192.168.204.45@tcp:58:lfs.0 00000040:00080000:2.0:1788651936.018073:0:6509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788651936.018149:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+26:12479:x1875537125550080:12345-192.168.204.45@tcp:58:lfs.0 Request processed in 564us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651936.018158:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 248 00000100:00100000:3.0:1788651936.060674:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651936.060871:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125550208 00000100:00100000:1.0:1788651936.060881:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125550208 00000100:00100000:0.0:1788651936.064049:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 249 00000100:00100000:0.0:1788651936.064092:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+26:12483:x1875537125550208:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788651936.064118:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788651936.064153:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4c70 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33fbb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.064220:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4c77 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.064237:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4c77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.064249:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4c77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.064272:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4c7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.064279:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.064286:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.064370:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.064381:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f7c expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.064390:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.064439:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f7c expref: 27 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.064455:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f7c expref: 27 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651936.064469:0:6510:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1875537147619200:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788651936.064575:0:6510:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c36a3840 going to sleep for 11 seconds 00000100:00100000:3.0:1788651936.067169:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651936.067473:0:6510:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6510:1875537147619200:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788651936.067508:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788651936.067588:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125550464 00000100:00100000:2.0:1788651936.067596:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125550464 00000100:00100000:2.0:1788651936.067661:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 63 00000100:00100000:2.0:1788651936.067672:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+28:6164:x1875537125550464:12345-192.168.204.45@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788651936.067900:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:6164:x1875537125550464:12345-192.168.204.45@tcp:35:ldlm_bl.0 Request processed in 229us (741us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788651936.067940:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 63 00000100:00100000:1.0:1788651936.071350:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651936.071513:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125550592 00000100:00100000:0.0:1788651936.071523:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125550592 00010000:00010000:0.0:1788651936.071564:0:6496:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f7c expref: 29 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788651936.071604:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 106 00000100:00100000:0.0:1788651936.071615:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:2388:x1875537125550592:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651936.071632:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651936.071653:0:6496:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f7c expref: 29 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.071667:0:6496:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f7c expref: 29 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.071704:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4b90 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f7c expref: 29 pid: 6511 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.071719:0:6496:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788651936.071736:0:6496:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.071745:0:6496:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.071752:0:6496:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651936.071782:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651936.071845:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+28:2388:x1875537125550592:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 231us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651936.071853:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 106 00010000:00010000:3.0:1788651936.071989:0:6510:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.071998:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651936.072049:0:6510:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788651936.072055:0:6510:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788651936.072074:0:6510:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072087:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072096:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4c77 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072102:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4c77 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072115:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4c77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072120:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651936.072124:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4c77 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072131:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4c77 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072153:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:3.0:1788651936.072156:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651936.072160:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4c77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072166:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97a00/0xcd2f56ea038c4c77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072177:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4c7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072184:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4c7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072189:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4c7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072193:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651936.072196:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4c7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072213:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4c7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072221:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff8f85c3352300) 00010000:00010000:3.0:1788651936.072223:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788651936.072226:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4c7e lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072232:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97600/0xcd2f56ea038c4c7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072265:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97400/0xcd2f56ea038c4c70 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fbb expref: 28 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072278:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fbb expref: 27 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651936.072284:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:3.0:1788651936.072286:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788651936.072288:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96c00, rc 0) 00000100:00100000:3.0:1788651936.072390:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12483:x1875537125550208:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 8235us (11652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651936.072400:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 249 00000100:00100000:2.0:1788651936.224740:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147619328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788651936.224809:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651936.224900:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651936.225719:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147619328 00000100:00100000:1.0:1788651936.225729:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147619328 00000100:00100000:1.0:1788651936.225887:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788651936.225897:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147619328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788651936.225969:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788651936.226021:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147619328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (1211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651936.226028:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788651936.226410:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147619328:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1788651936.745717:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:1.0:1788651936.745738:0:8422:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000040:00080000:3.0:1788651937.062093:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788651937.062101:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788651937.062124:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788651937.062137:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788651937.062266:0:13788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147619456:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788651937.062369:0:13788:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbcb40 going to sleep for 11 seconds 00000040:00080000:1.0:1788651937.080331:0:14753:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788651937.080342:0:14753:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788651937.080378:0:14753:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788651937.080388:0:14753:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788651937.081478:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651937.081529:0:13788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13788:1875537147619456:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788651937.081653:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125550720 00000100:00100000:2.0:1788651937.081660:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125550720 00000100:00100000:2.0:1788651937.081705:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 250 00000100:00100000:2.0:1788651937.081714:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12494:x1875537125550720:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788651937.081746:0:12192:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788651937.081855:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12494:x1875537125550720:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 141us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651937.081864:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 250 00000100:00100000:2.0:1788651937.092160:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651937.092468:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125550976 00000100:00100000:1.0:1788651937.092482:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125550976 00000100:00100000:1.0:1788651937.092550:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 251 00000100:00100000:1.0:1788651937.092560:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+27:12494:x1875537125550976:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788651937.092584:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788651937.092608:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4c8c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33fc2 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651937.092734:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9c00/0xcd2f56ea038c4c93 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651937.092749:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9c00/0xcd2f56ea038c4c93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651937.092763:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9c00/0xcd2f56ea038c4c93 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788651937.092775:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788651937.092923:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9400/0xcd2f56ea038c4c8c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fc2 expref: 30 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651937.092958:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9c00/0xcd2f56ea038c4c93 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fc2 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651937.092968:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:1.0:1788651937.092971:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788651937.092975:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9c00, rc 0) 00000100:00100000:1.0:1788651937.093032:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:12494:x1875537125550976:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 473us (880us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788651937.093039:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 251 00000100:00100000:2.0:1788651937.107397:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651937.107502:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125551104 00000100:00100000:0.0:1788651937.107513:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125551104 00000100:00100000:2.0:1788651937.107526:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651937.107578:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:0.0:1788651937.107589:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:2389:x1875537125551104:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788651937.107604:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788651937.107628:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9c00/0xcd2f56ea038c4c93 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fc2 expref: 29 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651937.107663:0:6495:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:0.0:1788651937.107675:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788651937.107747:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+28:2389:x1875537125551104:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 159us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651937.107754:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:3.0:1788651937.107863:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125551360 00000100:00100000:3.0:1788651937.107869:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125551360 00000100:00100000:3.0:1788651937.107985:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 252 00000100:00100000:3.0:1788651937.107996:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+28:12494:x1875537125551360:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788651937.108116:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651937.108131:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651937.108143:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651937.108328:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651937.108337:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651937.108344:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651937.108350:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651937.108355:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651937.108362:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651937.108384:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:3.0:1788651937.108386:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788651937.108391:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651937.108397:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651937.108502:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:12494:x1875537125551360:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 508us (974us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788651937.108511:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 252 00000040:00080000:2.0:1788651937.108801:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651937.108806:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651937.111940:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788651937.111958:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788651937.133515:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651937.133593:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125551616 00000100:00100000:3.0:1788651937.133604:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125551616 00000100:00100000:3.0:1788651937.133666:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 64 00000100:00100000:3.0:1788651937.133677:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+29:12494:x1875537125551616:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788651937.134145:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:12494:x1875537125551616:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 468us (642us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788651937.134154:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 64 00010000:00010000:1.0:1788651937.249131:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651937.762447:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651937.762471:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147619584:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651937.762561:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651937.769683:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147619584 00000100:00100000:2.0:1788651937.769698:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147619584 00000100:00100000:2.0:1788651937.769769:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788651937.769778:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147619584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788651937.769819:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788651937.770047:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147619584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 268us (7486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651937.770055:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788651937.774747:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147619584:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651937.956071:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651937.956122:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651937.956155:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651937.956183:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651937.956205:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651937.956221:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651937.956241:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651937.956275:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125552000 00000100:00100000:2.0:1788651937.956295:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125552000 00000100:00100000:2.0:1788651937.956348:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125552512 00000100:00100000:2.0:1788651937.956351:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125552512 00000100:00100000:2.0:1788651937.956364:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125551872 00000100:00100000:2.0:1788651937.956365:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125551872 00000100:00100000:2.0:1788651937.956375:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125552384 00000100:00100000:2.0:1788651937.956376:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125552384 00000100:00100000:1.0:1788651937.956534:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125552256 00000100:00100000:1.0:1788651937.956539:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125552256 00000100:00100000:1.0:1788651937.956571:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125552128 00000100:00100000:1.0:1788651937.956574:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125552128 00000100:00100000:1.0:1788651937.956606:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 139 00000100:00100000:1.0:1788651937.956616:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125552256:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651937.956703:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125552256:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 88us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651937.956710:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 139 00000100:00100000:1.0:1788651937.956727:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 140 00000100:00100000:1.0:1788651937.956734:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125552128:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651937.956757:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125552128:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 25us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651937.956763:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 140 00000100:00100000:1.0:1788651937.956816:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 346 00000100:00100000:1.0:1788651937.956823:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125552000:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651937.956853:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2388:x1875537125552000:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 31us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651937.956858:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 346 00000100:00100000:1.0:1788651937.956875:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 347 00000100:00100000:1.0:1788651937.956881:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125552512:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651937.956904:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125552512:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 23us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651937.956943:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 347 00000100:00100000:1.0:1788651937.956955:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 348 00000100:00100000:1.0:1788651937.956961:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:2388:x1875537125551872:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651937.956990:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:2388:x1875537125551872:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 28us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651937.956995:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 348 00000100:00100000:2.0:1788651937.957741:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 349 00000100:00100000:2.0:1788651937.957752:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125552384:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651937.957798:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2388:x1875537125552384:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 49us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651937.957805:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 349 00000100:00080000:3.0:1788651937.957998:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651937.958004:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651937.958007:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651937.958009:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788651937.958499:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125551744 00000100:00100000:0.0:1788651937.958509:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125551744 00000100:00100000:0.0:1788651937.958569:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 396 00000100:00100000:0.0:1788651937.958577:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125551744:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651937.958677:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2388:x1875537125551744:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 100us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651937.958750:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 396 00010000:00010000:2.0:1788651938.275337:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788651939.059220:0:14805:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651939.059230:0:14805:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651939.059271:0:14805:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788651939.059277:0:14805:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651939.258128:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651939.260333:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125552768 00000100:00100000:2.0:1788651939.260350:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125552768 00000100:00100000:3.0:1788651939.260621:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 253 00000100:00100000:3.0:1788651939.260635:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+30:12515:x1875537125552768:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788651939.260657:0:6511:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651939.260678:0:6511:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33fc9 expref: -99 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.260797:0:6511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4caf lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.260811:0:6511:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4caf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.260823:0:6511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4caf lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6511 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788651939.260833:0:6511:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788651939.261023:0:6511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907600/0xcd2f56ea038c4ca8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fc9 expref: 33 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.261045:0:6511:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4caf lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fc9 expref: 32 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.261054:0:6511:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:3.0:1788651939.261057:0:6511:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788651939.261060:0:6511:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906c00, rc 0) 00000100:00100000:3.0:1788651939.261222:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:12515:x1875537125552768:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 590us (3104us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788651939.261230:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 253 00000100:00080000:0.0:1788651939.261485:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651939.265752:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651939.266704:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125552896 00000100:00100000:3.0:1788651939.266717:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125552896 00000100:00100000:3.0:1788651939.266784:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 254 00000100:00100000:3.0:1788651939.266794:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:12515:x1875537125552896:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:3.0:1788651939.266863:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4cbd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.266892:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.266904:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.267151:0:6510:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4cbd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.267159:0:6510:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4cbd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.267167:0:6510:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4cbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.267172:0:6510:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651939.267177:0:6510:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4cbd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.267184:0:6510:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4cbd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.267195:0:6510:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:3.0:1788651939.267198:0:6510:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788651939.267203:0:6510:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4cbd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.267208:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906200/0xcd2f56ea038c4cbd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6510 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788651939.267302:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+32:12515:x1875537125552896:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 509us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651939.267317:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 254 00000100:00100000:2.0:1788651939.296425:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788651939.297041:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651939.297158:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651939.297179:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147619840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651939.297247:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651939.297323:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147619840 00000100:00100000:1.0:1788651939.297331:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147619840 00000100:00100000:1.0:1788651939.297385:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788651939.297393:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147619840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788651939.297419:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788651939.297477:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3636:x1875537147619840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651939.297485:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1788651939.297508:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788651939.297542:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147619840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788651939.299934:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788651939.299958:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147619968:0@lo:400:kworker.0 00000100:00100000:0.0:1788651939.300030:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651939.300598:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147619968 00000100:00100000:1.0:1788651939.300607:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147619968 00000100:00100000:1.0:1788651939.300660:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788651939.300669:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147619968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651939.300730:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3635:x1875537147619968:12345-0@lo:400:kworker.0 Request processed in 62us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651939.300737:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788651939.300783:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147619968:0@lo:400:kworker.0 00000100:00100000:2.0:1788651939.301281:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147620096:0@lo:400:kworker.0 00000100:00100000:2.0:1788651939.301316:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651939.301392:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147619712:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651939.301419:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651939.301501:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147619712 00000100:00100000:0.0:1788651939.301507:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147619712 00000100:00100000:0.0:1788651939.301563:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788651939.301570:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147619712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788651939.301604:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788651939.301656:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147619712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651939.301663:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788651939.301816:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651939.301860:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147619712:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651939.302155:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147620480:0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.302187:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651939.302207:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147620992:0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.302225:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651939.302241:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788651939.302246:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147620352:0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.302279:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651939.302316:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147620608:0@lo:400:kworker.0 00000100:00100000:0.0:1788651939.302435:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147620224:0@lo:400:kworker.0 00000100:00100000:0.0:1788651939.302460:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651939.302486:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147620736:0@lo:400:kworker.0 00000100:00100000:2.0:1788651939.302546:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147620480 00000100:00100000:2.0:1788651939.302551:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147620480 00000100:00100000:2.0:1788651939.302600:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147620224 00000100:00100000:2.0:1788651939.302603:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147620224 00000100:00100000:2.0:1788651939.302618:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788651939.302624:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147620480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651939.302663:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147620480:12345-0@lo:400:kworker.0 Request processed in 38us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651939.302679:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788651939.302692:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1788651939.302696:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147620224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651939.302726:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147620224:12345-0@lo:400:kworker.0 Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651939.302732:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788651939.303219:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147620864:0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.303244:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651939.303284:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147620480:0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.303313:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147620992 00000100:00100000:3.0:1788651939.303317:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147620992 00000100:00100000:3.0:1788651939.303361:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147620864 00000100:00100000:3.0:1788651939.303363:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147620864 00000100:00100000:3.0:1788651939.303381:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788651939.303386:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147620992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.303424:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147620992:12345-0@lo:400:kworker.0 Request processed in 37us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651939.303429:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788651939.303441:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788651939.303446:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147620864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.303470:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147620864:12345-0@lo:400:kworker.0 Request processed in 25us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651939.303477:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1788651939.303508:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651939.303528:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147620864:0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.303536:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788651939.303541:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1788651939.303566:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f85c310aa00, transno 4294967308 00000100:00100000:0.0:1788651939.303690:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788651939.303705:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788651939.303716:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f85c3d51180, transno 4294967311 00000100:00100000:3.0:1788651939.303722:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147620992:0@lo:400:kworker.0 00000100:00100000:1.0:1788651939.303746:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147620096 00000100:00100000:1.0:1788651939.303753:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147620096 00000100:00100000:1.0:1788651939.303790:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147620352 00000100:00100000:1.0:1788651939.303793:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147620352 00000100:00100000:1.0:1788651939.303819:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788651939.303827:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147620096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651939.303869:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147620096:12345-0@lo:400:kworker.0 Request processed in 43us (2551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651939.303875:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788651939.303889:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788651939.303896:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147620352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651939.303948:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147620352:12345-0@lo:400:kworker.0 Request processed in 53us (1668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651939.303983:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788651939.304030:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147620352:0@lo:400:kworker.0 00000100:00100000:0.0:1788651939.306902:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147621248:0@lo:400:kworker.0 00000100:00100000:0.0:1788651939.307277:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651939.307536:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651939.307566:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147620736 00000100:00100000:3.0:1788651939.307575:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147620736 00000100:00100000:3.0:1788651939.307652:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147621248 00000100:00100000:3.0:1788651939.307656:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147621248 00000100:00100000:3.0:1788651939.307682:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788651939.307690:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147620736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.307747:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3638:x1875537147620736:12345-0@lo:400:kworker.0 Request processed in 56us (4056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651939.307755:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788651939.307770:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788651939.307775:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147621248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.307802:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147621248:12345-0@lo:400:kworker.0 Request processed in 26us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651939.307806:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00080000:3.0:1788651939.307823:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788651939.308567:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d109aa00 x1875537147621248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651939.308582:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147621248:0@lo:400:kworker.0 00000100:00100000:0.0:1788651939.308625:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147620224:0@lo:400:kworker.0 00010000:00080000:0.0:1788651939.308637:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d109b800 x1875537147620736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651939.308646:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3638:1875537147620736:0@lo:400:kworker.0 00000100:00100000:2.0:1788651939.313388:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147621120:0@lo:400:kworker.0 00000100:00100000:2.0:1788651939.313451:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651939.315383:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147620608 00000100:00100000:0.0:1788651939.315383:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147621120 00000100:00100000:0.0:1788651939.315395:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147621120 00000100:00100000:2.0:1788651939.315404:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147620096:0@lo:400:kworker.0 00000100:00100000:0.0:1788651939.315466:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1788651939.315476:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147621120:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788651939.315517:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788651939.315552:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147621120:12345-0@lo:400:kworker.0 Request processed in 77us (2100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651939.315559:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788651939.315573:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147620608 00000100:00100000:2.0:1788651939.315638:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147621120:0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.315709:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788651939.315718:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147620608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651939.315783:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147620608:12345-0@lo:400:kworker.0 Request processed in 66us (8246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651939.315790:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788651939.315934:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147620608:0@lo:400:kworker.0 00000100:00080000:1.0:1788651939.316088:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651939.376419:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651939.376577:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125553024 00000100:00100000:3.0:1788651939.376741:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125553024 00000100:00080000:1.0:1788651939.376882:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651939.378083:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 80 00000100:00100000:3.0:1788651939.378112:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2388:x1875537125553024:12345-192.168.204.45@tcp:101:cat.0 00010000:00010000:3.0:1788651939.378134:0:8744:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788651939.378157:0:8744:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044a657e8/0xcd2f56ea038c4cc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33fd0 expref: -99 pid: 8744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788651939.378184:0:8744:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ca99e, atime: 0x6a9ca99e, ctime: 0x6a9ca99e, blocks: 0x8 00010000:00010000:3.0:1788651939.378207:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=395s v=(0 0) 00010000:00010000:3.0:1788651939.378212:0:8744:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788651939.378222:0:8744:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044a657e8/0xcd2f56ea038c4cc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fd0 expref: 8 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.378238:0:8744:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044a657e8/0xcd2f56ea038c4cc4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fd0 expref: 8 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651939.378262:0:8744:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906200, rc 0) 00000100:00100000:3.0:1788651939.378334:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2388:x1875537125553024:12345-192.168.204.45@tcp:101:cat.0 Request processed in 240us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651939.378341:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 80 00000100:00100000:1.0:1788651939.387214:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651939.387377:0:8432:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125553152 00000100:00100000:2.0:1788651939.387389:0:8432:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125553152 00002000:00100000:2.0:1788651939.387440:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8f85c35c2300 x1875537125553152/t0(0) o3->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:325/0 lens 488/0 e 0 to 0 dl 1788651950 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651939.387453:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c35c2300 with x1875537125553152 ext(0->4095) 00002000:00010000:2.0:1788651939.387459:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f85c35c2300 00000100:00100000:2.0:1788651939.387492:0:8432:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:2.0:1788651939.387502:0:8432:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2390:x1875537125553152:12345-192.168.204.45@tcp:3:cat.0 00000100:00100000:2.0:1788651939.387701:0:8432:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+8:2390:x1875537125553152:12345-192.168.204.45@tcp:3:cat.0 Request processed in 200us (508us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788651939.387709:0:8432:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 8 00002000:00100000:2.0:1788651939.387730:0:8432:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff8f85c35c2300 x1875537125553152/t0(0) o3->72121fb7-fb91-4477-92d5-4e7fe3e6b65d@192.168.204.45@tcp:325/0 lens 488/4536 e 0 to 0 dl 1788651950 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788651939.387739:0:8432:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c35c2300 with x1875537125553152 ext(0->4095) 00002000:00010000:2.0:1788651939.387742:0:8432:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f85c35c2300 00000100:00100000:1.0:1788651940.321091:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651940.321115:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147621376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651940.321192:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651940.321275:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147621376 00000100:00100000:1.0:1788651940.321283:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147621376 00000100:00100000:1.0:1788651940.321332:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788651940.321342:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147621376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651940.321372:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651940.321415:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147621376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651940.321422:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788651940.321469:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147621376:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788651940.324797:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651940.324900:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788651940.324957:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147621504:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651940.325027:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651940.327200:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147621504 00000100:00100000:0.0:1788651940.327215:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147621504 00000100:00100000:0.0:1788651940.327303:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788651940.327315:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147621504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788651940.327344:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651940.327423:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147621504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 110us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651940.327431:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788651940.327503:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147621504:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788651941.344392:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651941.344583:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788651941.344607:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147621632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788651941.344685:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651941.344818:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147621632 00000100:00100000:2.0:1788651941.344828:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147621632 00000100:00100000:2.0:1788651941.344883:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788651941.344893:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147621632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788651941.344955:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788651941.345108:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147621632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 215us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651941.345115:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1788651941.345202:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147621632:0@lo:41:osp-pre-1-0.0 00000001:00080000:1.0:1788651941.868006:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:1.0:1788651941.868024:0:9506:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1788651941.869844:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1788651941.869878:0:6489:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8f86c2bb9b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788651941.869884:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86ff4be200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8f86c2bb9900 00000020:00080000:0.0:1788651941.869888:0:6489:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8f86ff4be000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8f85c3fcba00 00010000:00010000:3.0:1788651941.869977:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651941.870007:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651941.870025:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651941.870031:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788651941.870037:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651941.870045:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651941.870064:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff8f86c3228600) 00010000:00010000:3.0:1788651941.870068:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000020:00080000:1.0:1788651941.870070:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00010000:00010000:3.0:1788651941.870073:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651941.870081:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6200/0xcd2f56ea038c4c3f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6509 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788651941.870150:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788651941.871297:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:0.0:1788651942.368271:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651942.880452:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651942.880484:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147621760:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651942.880561:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651942.882994:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147621760 00000100:00100000:2.0:1788651942.883012:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147621760 00000100:00100000:2.0:1788651942.883087:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788651942.883098:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147621760:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788651942.883139:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788651942.883258:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147621760:12345-0@lo:41:osp-pre-0-1.0 Request processed in 161us (2696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651942.883266:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1788651942.883485:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147621760:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651943.078883:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651943.079105:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125553408 00000100:00100000:1.0:1788651943.079115:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125553408 00000100:00100000:1.0:1788651943.079216:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 356 00000100:00100000:1.0:1788651943.079228:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:2389:x1875537125553408:12345-192.168.204.45@tcp:400:kworker.0 00000100:00080000:3.0:1788651943.079721:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651943.085206:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:2389:x1875537125553408:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 5953us (6322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651943.085222:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 356 00000100:00100000:3.0:1788651943.085655:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651943.085750:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651943.085788:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651943.085836:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651943.085858:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651943.085926:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125553280 00000100:00100000:2.0:1788651943.085935:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125553280 00000100:00100000:2.0:1788651943.085989:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 398 00000100:00100000:2.0:1788651943.085998:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125553280:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651943.086070:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125553280:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 73us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651943.086078:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 398 00000100:00100000:2.0:1788651943.086191:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125553920 00000100:00100000:2.0:1788651943.086195:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125553920 00000100:00100000:2.0:1788651943.086232:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125553536 00000100:00100000:2.0:1788651943.086235:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125553536 00000100:00100000:2.0:1788651943.086256:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 357 00000100:00100000:2.0:1788651943.086264:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125553920:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651943.089032:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 358 00000100:00100000:1.0:1788651943.089076:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125553536:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651943.089149:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125553536:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 105us (3311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651943.089157:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 358 00000100:00080000:1.0:1788651943.089392:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788651943.089397:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651943.089639:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125553920:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 36us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651943.089648:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 357 00000100:00100000:3.0:1788651943.100611:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651943.100659:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125554048 00000100:00100000:3.0:1788651943.100669:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125554048 00000100:00100000:3.0:1788651943.100748:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 359 00000100:00100000:3.0:1788651943.100758:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125554048:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651943.100828:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125554048:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 72us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651943.100835:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 359 00000100:00080000:3.0:1788651943.100856:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788651943.103100:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125553664 00000100:00100000:0.0:1788651943.103116:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125553664 00000100:00100000:0.0:1788651943.103217:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125553792 00000100:00100000:0.0:1788651943.103221:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125553792 00000100:00100000:0.0:1788651943.103264:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 143 00000100:00100000:0.0:1788651943.103275:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125553664:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651943.103353:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125553664:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 81us (17752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651943.103375:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 143 00000100:00100000:0.0:1788651943.103395:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 144 00000100:00100000:0.0:1788651943.103402:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125553792:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788651943.103438:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125553792:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 37us (17579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651943.103445:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 144 00000100:00080000:3.0:1788651943.104743:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651943.104750:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788651943.396399:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651944.429050:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147621888:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651944.429119:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.429207:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147621888 00000100:00100000:3.0:1788651944.429215:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147621888 00000100:00100000:3.0:1788651944.429271:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788651944.429279:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147621888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788651944.429306:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788651944.429344:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147621888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651944.429350:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1788651944.429368:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788651944.429404:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147621888:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788651944.430323:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651944.430463:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147622016:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.430712:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.430749:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147622528:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.430770:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.430786:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147623040:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.430805:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.430827:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788651944.430832:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147622400:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.430853:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.430875:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147622912:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.430891:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.430929:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147623424:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.430949:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.430979:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147622144:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.430999:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.431013:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147622656:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.431027:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.431039:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147623168:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.431054:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.431067:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788651944.431071:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147622272:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.431088:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.431102:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147622784:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.431116:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.431128:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147623296:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.431168:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.431194:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147622528 00000100:00100000:3.0:1788651944.431200:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147622528 00000100:00100000:3.0:1788651944.431235:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147622272 00000100:00100000:3.0:1788651944.431238:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147622272 00000100:00100000:3.0:1788651944.431250:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788651944.431257:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147622528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.431304:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147622528:12345-0@lo:400:kworker.0 Request processed in 47us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651944.431311:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788651944.431324:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788651944.431329:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147622272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.431352:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147622272:12345-0@lo:400:kworker.0 Request processed in 23us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651944.431357:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788651944.431370:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147623040 00000100:00100000:3.0:1788651944.431372:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147623040 00000100:00100000:3.0:1788651944.431397:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147622912 00000100:00100000:3.0:1788651944.431399:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147622912 00000100:00100000:3.0:1788651944.431407:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147623424 00000100:00100000:3.0:1788651944.431409:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147623424 00000100:00100000:3.0:1788651944.431421:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788651944.431426:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147623040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.431451:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147623040:12345-0@lo:400:kworker.0 Request processed in 25us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651944.431457:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788651944.431466:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788651944.431483:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147622912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651944.431672:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147622400 00000100:00100000:1.0:1788651944.431677:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147622400 00000100:00100000:1.0:1788651944.431698:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147622144 00000100:00100000:1.0:1788651944.431701:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147622144 00000100:00100000:1.0:1788651944.431708:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147622656 00000100:00100000:1.0:1788651944.431710:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147622656 00000100:00100000:1.0:1788651944.431718:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147623168 00000100:00100000:1.0:1788651944.431720:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147623168 00000100:00100000:1.0:1788651944.431730:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147622784 00000100:00100000:1.0:1788651944.431731:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147622784 00000100:00100000:1.0:1788651944.431741:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147623296 00000100:00100000:1.0:1788651944.431743:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147623296 00000100:00100000:1.0:1788651944.431754:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788651944.431758:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147622400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651944.431788:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147622400:12345-0@lo:400:kworker.0 Request processed in 29us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651944.431793:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788651944.431804:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788651944.431815:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147622144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651944.431838:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147622144:12345-0@lo:400:kworker.0 Request processed in 24us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651944.431842:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788651944.431852:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788651944.431856:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147622656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651944.431874:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147622656:12345-0@lo:400:kworker.0 Request processed in 18us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651944.431879:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788651944.431886:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788651944.431890:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147623168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651944.431927:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147623168:12345-0@lo:400:kworker.0 Request processed in 36us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651944.431933:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788651944.431944:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788651944.431949:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147622784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651944.431976:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147622784:12345-0@lo:400:kworker.0 Request processed in 27us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651944.431981:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788651944.431992:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788651944.431998:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147623296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651944.432021:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147623296:12345-0@lo:400:kworker.0 Request processed in 24us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651944.432026:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:0.0:1788651944.432381:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147622016 00000100:00100000:0.0:1788651944.432386:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147622016 00000100:00100000:0.0:1788651944.432428:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788651944.432435:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147622016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651944.432471:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147622016:12345-0@lo:400:kworker.0 Request processed in 36us (1758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651944.432476:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:3.0:1788651944.435353:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147622912:12345-0@lo:400:kworker.0 Request processed in 3864us (4453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651944.435365:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788651944.435393:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788651944.435404:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147623424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.435434:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147623424:12345-0@lo:400:kworker.0 Request processed in 35us (4484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651944.435440:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788651944.436303:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147623552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651944.436355:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651944.436412:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147622400:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.436423:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147622912:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.436429:0:3636:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:3.0:1788651944.436434:0:3636:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8f85c3cbed80, transno 4294967323 00000004:00080000:3.0:1788651944.436447:0:3636:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:3.0:1788651944.436467:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147623424:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.436487:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147622016:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.436506:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147622528:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.436519:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147623040:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.436564:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147622272:0@lo:400:kworker.0 00010000:00080000:3.0:1788651944.436579:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d1099f80 x1875537147622784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651944.436611:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147622784:0@lo:400:kworker.0 00010000:00080000:3.0:1788651944.436628:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff51a680 x1875537147623296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651944.436636:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147623296:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.436646:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147622144:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.436656:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147622656:0@lo:400:kworker.0 00000100:00100000:3.0:1788651944.436665:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147623168:0@lo:400:kworker.0 00000100:00080000:3.0:1788651944.436693:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788651944.436700:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651944.436703:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651944.436706:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651944.439211:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147623552 00000100:00100000:0.0:1788651944.439227:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147623552 00000100:00100000:0.0:1788651944.439411:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788651944.439422:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147623552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651944.439447:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788651944.439541:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147623552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (3185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651944.439548:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788651944.439671:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147623552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651944.575628:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651944.575959:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125554176 00000100:00100000:1.0:1788651944.575991:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125554176 00000100:00100000:1.0:1788651944.576057:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 255 00000100:00100000:1.0:1788651944.576067:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:12168:x1875537125554176:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788651944.576207:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:12168:x1875537125554176:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 Request processed in 141us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651944.576216:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 255 00000100:00100000:0.0:1788651944.584649:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651944.584771:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125554304 00000100:00100000:3.0:1788651944.584784:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125554304 00000100:00100000:3.0:1788651944.584851:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 256 00000100:00100000:3.0:1788651944.584862:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:12168:x1875537125554304:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788651944.585265:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:12168:x1875537125554304:12345-192.168.204.45@tcp:60:lhsmtool_posix.0 Request processed in 402us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651944.585274:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 256 00000100:00100000:2.0:1788651944.597736:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651944.599289:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125554560 00000100:00100000:3.0:1788651944.599303:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125554560 00000100:00100000:3.0:1788651944.599430:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 65 00000100:00100000:3.0:1788651944.599442:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:12168:x1875537125554560:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788651944.599983:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:12168:x1875537125554560:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 450us (2164us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788651944.599992:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 65 00000100:00100000:0.0:1788651944.830691:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651944.830978:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125554688 00000100:00100000:2.0:1788651944.830989:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125554688 00000100:00100000:2.0:1788651944.831050:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 257 00000100:00100000:2.0:1788651944.831061:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:12972:x1875537125554688:12345-192.168.204.45@tcp:101:lsof.0 00010000:00010000:2.0:1788651944.831080:0:12192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788651944.831100:0:12192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4ccb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33fd7 expref: -99 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651944.831180:0:12192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4cd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651944.831193:0:12192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651944.831218:0:12192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788651944.831264:0:12192:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788651944.831268:0:12192:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788651944.831289:0:12192:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12192 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651944.831317:0:12192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7a00/0xcd2f56ea038c4ccb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fd7 expref: 7 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651944.831340:0:12192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fd7 expref: 6 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651944.831350:0:12192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651944.831353:0:12192:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651944.831357:0:12192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6e00, rc 0) 00000100:00100000:2.0:1788651944.832062:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:12972:x1875537125554688:12345-192.168.204.45@tcp:101:lsof.0 Request processed in 999us (1376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651944.832070:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 257 00000040:00080000:0.0:1788651945.056792:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788651945.440443:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147623680:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651945.440532:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651945.440721:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147623680 00000100:00100000:1.0:1788651945.440730:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147623680 00000100:00100000:1.0:1788651945.440782:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788651945.440791:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147623680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651945.440821:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651945.440941:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147623680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651945.440949:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00010000:00010000:0.0:1788651945.446071:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651945.446441:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147623808:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651945.446512:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651945.446823:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147623808 00000100:00100000:1.0:1788651945.446832:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147623808 00000100:00100000:1.0:1788651945.446883:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788651945.446893:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147623808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651945.446937:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651945.446996:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147623808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651945.447003:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788651945.447120:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147623808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788651945.450395:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147623680:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788651946.336336:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651946.336346:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651946.336439:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1788651946.336446:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651946.464489:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147623936:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788651946.464564:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651946.464801:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147623936 00000100:00100000:3.0:1788651946.464810:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147623936 00000100:00100000:3.0:1788651946.464865:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788651946.464875:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147623936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651946.464952:0:6515:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651946.465011:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147623936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 137us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651946.465017:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1788651946.465159:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147623936:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788651946.465366:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651947.488080:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651948.000173:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147624064:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651948.000264:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651948.000802:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147624064 00000100:00100000:3.0:1788651948.000811:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147624064 00000100:00100000:3.0:1788651948.000859:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1788651948.000868:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147624064:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788651948.000905:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788651948.000990:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147624064:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651948.000998:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1788651948.001695:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147624064:0@lo:41:osp-pre-0-1.0 00000001:00080000:0.0:1788651948.015953:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1788651948.015981:0:6489:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1788651948.016004:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1788651948.016018:0:6541:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:1.0:1788651948.199195:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651948.199272:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651948.199319:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651948.199336:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651948.199353:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651948.199368:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651948.199389:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651948.199428:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125555072 00000100:00100000:1.0:1788651948.199438:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125555072 00000100:00100000:1.0:1788651948.199562:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125555584 00000100:00100000:1.0:1788651948.199566:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125555584 00000100:00100000:1.0:1788651948.199580:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125554944 00000100:00100000:1.0:1788651948.199582:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125554944 00000100:00100000:1.0:1788651948.199592:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125555456 00000100:00100000:1.0:1788651948.199594:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125555456 00000100:00100000:1.0:1788651948.199606:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 366 00000100:00100000:1.0:1788651948.199615:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125555072:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651948.199749:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125555072:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 134us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651948.199756:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 366 00000100:00100000:1.0:1788651948.199771:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 367 00000100:00100000:1.0:1788651948.199777:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125555584:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651948.199975:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125555584:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 196us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651948.199983:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 367 00000100:00100000:1.0:1788651948.199997:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 368 00000100:00100000:1.0:1788651948.200003:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:2389:x1875537125554944:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651948.200032:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:2389:x1875537125554944:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 30us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651948.200049:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 368 00000100:00100000:1.0:1788651948.200062:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 369 00000100:00100000:1.0:1788651948.200068:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125555456:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651948.200194:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125555328 00000100:00100000:3.0:1788651948.200199:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125555328 00000100:00100000:3.0:1788651948.200231:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125555200 00000100:00100000:3.0:1788651948.200242:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125555200 00000100:00100000:3.0:1788651948.200268:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 148 00000100:00100000:3.0:1788651948.200276:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125555328:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651948.200305:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2389:x1875537125555328:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 30us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651948.200312:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 148 00000100:00100000:3.0:1788651948.200325:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 149 00000100:00100000:3.0:1788651948.200330:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125555200:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651948.200351:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2389:x1875537125555200:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 21us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651948.200356:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 149 00000100:00080000:3.0:1788651948.200376:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788651948.200381:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788651948.200383:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788651948.200385:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651948.200740:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2389:x1875537125555456:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 670us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651948.200747:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 369 00000100:00100000:2.0:1788651948.201614:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125554816 00000100:00100000:2.0:1788651948.201622:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125554816 00000100:00100000:2.0:1788651948.202025:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 400 00000100:00100000:2.0:1788651948.202036:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125554816:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788651948.202107:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2389:x1875537125554816:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 74us (2987us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651948.202114:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 400 00000001:02000400:2.0:1788651948.400630:0:15003:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 19:45:46 (1788651946) 00010000:00010000:0.0:1788651948.513238:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651949.536177:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147624192:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788651949.536255:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651949.536297:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147624320:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.536315:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147624704:0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.536334:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651949.536343:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651949.536361:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147624832:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.536361:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147625216:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.536383:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651949.536400:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147625728:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.536419:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651949.536452:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147624704 00000100:00100000:1.0:1788651949.536459:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147624704 00000100:00100000:3.0:1788651949.536463:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147624448:0@lo:400:kworker.0 00000100:00100000:3.0:1788651949.536492:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651949.536502:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147624448 00000100:00100000:1.0:1788651949.536505:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147624448 00000100:00100000:3.0:1788651949.536510:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147624960:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.536525:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788651949.536528:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651949.536533:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147624704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651949.536542:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147625472:0@lo:400:kworker.0 00000100:00100000:3.0:1788651949.536560:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651949.536572:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788651949.536578:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147624576:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.536580:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147624704:12345-0@lo:400:kworker.0 Request processed in 47us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651949.536587:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1788651949.536598:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651949.536604:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147624960 00000100:00100000:3.0:1788651949.536613:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147625088:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.536617:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147624960 00000100:00100000:3.0:1788651949.536641:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651949.536641:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147625472 00000100:00100000:1.0:1788651949.536643:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147625472 00000100:00100000:3.0:1788651949.536650:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147625600:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.536653:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147625088 00000100:00100000:1.0:1788651949.536655:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147625088 00000100:00100000:3.0:1788651949.536668:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651949.536668:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:1.0:1788651949.536673:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147624448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651949.536687:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147625600 00000100:00100000:3.0:1788651949.536690:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147625600 00000100:00100000:1.0:1788651949.536704:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147624448:12345-0@lo:400:kworker.0 Request processed in 30us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651949.536709:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1788651949.536712:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788651949.536717:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147624960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.536719:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788651949.536724:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147625472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651949.536744:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147624960:12345-0@lo:400:kworker.0 Request processed in 27us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651949.536744:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147625472:12345-0@lo:400:kworker.0 Request processed in 20us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651949.536750:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1788651949.536784:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651949.536803:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147625344:0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.536822:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651949.536838:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147625856:0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.536854:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651949.536883:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147624192 00010000:00010000:0.0:1788651949.536884:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651949.536886:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147624192 00000100:00100000:2.0:1788651949.536928:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788651949.536934:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147624192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651949.536957:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788651949.537150:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147624192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 215us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651949.537165:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788651949.537189:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147624320 00000100:00100000:2.0:1788651949.537193:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147624320 00000100:00100000:2.0:1788651949.537221:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788651949.537227:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147624320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.537259:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c8da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147624320:12345-0@lo:400:kworker.0 Request processed in 33us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651949.537265:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:2.0:1788651949.537289:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147624576 00000100:00100000:2.0:1788651949.537292:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147624576 00000100:00100000:2.0:1788651949.537312:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147624832 00000100:00100000:2.0:1788651949.537314:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147624832 00000100:00100000:2.0:1788651949.537327:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788651949.537332:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147624576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.537360:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147624576:12345-0@lo:400:kworker.0 Request processed in 28us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651949.537365:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1788651949.537390:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788651949.537396:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147624832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.537420:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147624832:12345-0@lo:400:kworker.0 Request processed in 26us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651949.537425:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788651949.537442:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147625216 00000100:00100000:2.0:1788651949.537445:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147625216 00000100:00100000:2.0:1788651949.537460:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147625728 00000100:00100000:2.0:1788651949.537462:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147625728 00000100:00100000:2.0:1788651949.537470:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147625344 00000100:00100000:2.0:1788651949.537477:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147625344 00000100:00100000:2.0:1788651949.537489:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147625856 00000100:00100000:2.0:1788651949.537491:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147625856 00000100:00100000:2.0:1788651949.537501:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788651949.537506:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147625216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.537532:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147625216:12345-0@lo:400:kworker.0 Request processed in 27us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651949.537538:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788651949.537547:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788651949.537552:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147625728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.537571:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147625728:12345-0@lo:400:kworker.0 Request processed in 20us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651949.537576:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788651949.537585:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788651949.537589:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147625344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.537609:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147625344:12345-0@lo:400:kworker.0 Request processed in 20us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651949.537614:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788651949.537622:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788651949.537626:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147625856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.537647:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147625856:12345-0@lo:400:kworker.0 Request processed in 20us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651949.537652:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788651949.537692:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147624320:0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.537704:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147624832:0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.537721:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147625344:0@lo:400:kworker.0 00000100:00100000:2.0:1788651949.537728:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147625856:0@lo:400:kworker.0 00000100:00100000:3.0:1788651949.540648:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788651949.540701:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788651949.540719:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147625088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651949.540805:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147625088:12345-0@lo:400:kworker.0 Request processed in 96us (4163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651949.540812:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788651949.540831:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:3.0:1788651949.540840:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147625600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651949.540866:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147625600:12345-0@lo:400:kworker.0 Request processed in 28us (4196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651949.540872:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00000100:00080000:1.0:1788651949.543230:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788651949.543239:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651949.543243:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788651949.543245:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788651949.543330:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147625984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788651949.543403:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651949.543479:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147624576:0@lo:400:kworker.0 00010000:00080000:1.0:1788651949.543495:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c368f800 x1875537147625088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651949.543504:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147625088:0@lo:400:kworker.0 00010000:00080000:1.0:1788651949.543516:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c368c700 x1875537147625600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651949.543546:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147625600:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.543562:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147624448:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.543574:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147624960:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.543584:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147625472:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.543637:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147624704:0@lo:400:kworker.0 00000100:00100000:3.0:1788651949.543891:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147625984 00000100:00100000:3.0:1788651949.543898:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147625984 00000100:00100000:3.0:1788651949.543965:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788651949.543974:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147625984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788651949.543997:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788651949.544164:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147625216:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.544175:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147625728:0@lo:400:kworker.0 00000100:00100000:1.0:1788651949.544204:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147624192:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651949.544337:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147625984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 363us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651949.544354:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788651949.544392:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147625984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788651950.560078:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651950.561124:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651950.561148:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147626112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788651950.561228:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651950.561450:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147626112 00000100:00100000:1.0:1788651950.561459:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147626112 00000100:00100000:1.0:1788651950.561513:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788651950.561523:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147626112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788651950.561552:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651950.561601:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147626112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651950.561610:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788651950.561746:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147626112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651950.570184:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147626240:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651950.570262:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651950.570494:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147626240 00000100:00100000:0.0:1788651950.570503:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147626240 00000100:00100000:0.0:1788651950.570553:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788651950.570562:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147626240:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788651950.570586:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651950.570632:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147626240:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651950.570640:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788651950.571967:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147626240:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788651951.584098:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651951.585444:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147626368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788651951.585517:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651951.585755:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147626368 00000100:00100000:0.0:1788651951.585763:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147626368 00000100:00100000:0.0:1788651951.585829:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1788651951.585839:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147626368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788651951.585888:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788651951.594467:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147626368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 8619us (8938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651951.594482:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788651951.600044:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147626368:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788651952.254736:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651952.255417:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125555840 00000100:00100000:3.0:1788651952.255429:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125555840 00000100:00100000:3.0:1788651952.255544:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 66 00000100:00100000:3.0:1788651952.255556:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+18:13196:x1875537125555840:12345-192.168.204.45@tcp:35:umount.0 00000100:00100000:3.0:1788651952.255844:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:13196:x1875537125555840:12345-192.168.204.45@tcp:35:umount.0 Request processed in 289us (1117us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788651952.255853:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 66 00000100:00100000:0.0:1788651952.258648:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651952.258730:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125556096 00000100:00100000:3.0:1788651952.258740:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125556096 00000100:00100000:3.0:1788651952.258793:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00100000:3.0:1788651952.258803:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+19:13196:x1875537125556096:12345-192.168.204.45@tcp:35:umount.0 00000100:00100000:3.0:1788651952.259570:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:13196:x1875537125556096:12345-192.168.204.45@tcp:35:umount.0 Request processed in 766us (929us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788651952.259580:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00080000:1.0:1788651952.259954:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651952.263391:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651952.263493:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125556352 00000100:00100000:0.0:1788651952.263506:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125556352 00000100:00100000:0.0:1788651952.263597:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 68 00000100:00100000:0.0:1788651952.263607:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86da6e8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+20:13196:x1875537125556352:12345-192.168.204.45@tcp:35:umount.0 00000100:00100000:0.0:1788651952.263857:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86da6e8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:13196:x1875537125556352:12345-192.168.204.45@tcp:35:umount.0 Request processed in 251us (477us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788651952.263865:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 68 00000100:00100000:2.0:1788651952.266573:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651952.266674:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125556608 00000100:00100000:3.0:1788651952.266685:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125556608 00000100:00100000:3.0:1788651952.266774:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:3.0:1788651952.266785:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:13196:x1875537125556608:12345-192.168.204.45@tcp:35:umount.0 00000100:00100000:3.0:1788651952.267130:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:13196:x1875537125556608:12345-192.168.204.45@tcp:35:umount.0 Request processed in 346us (565us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788651952.267153:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:1.0:1788651952.272863:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651952.272903:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651952.272953:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651952.273045:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651952.273077:0:8428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125557376 00000100:00100000:1.0:1788651952.273087:0:8428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125557376 00000100:00100000:1.0:1788651952.273149:0:8428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 81 00000100:00100000:1.0:1788651952.273160:0:8428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+7:2387:x1875537125557376:12345-192.168.204.45@tcp:9:umount.0 00000020:00000080:1.0:1788651952.273192:0:8428:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c423d 00000020:00010000:1.0:1788651952.273200:0:8428:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f86c4e7a000: total 0 00000100:00080000:1.0:1788651952.273205:0:8428:0:(import.c:65:import_set_state_nolock()) ffff8f86c4e7b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788651952.273249:0:8428:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788651952.273414:0:8428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2387:x1875537125557376:12345-192.168.204.45@tcp:9:umount.0 Request processed in 255us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651952.273422:0:8428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 81 00000020:00010000:1.0:1788651952.273445:0:6498:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f86c4e7a000: total 0 00010000:00010000:1.0:1788651952.273467:0:6498:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f86c4e7a000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788651952.273526:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044a657e8/0xcd2f56ea038c4cc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fd0 expref: 4 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651952.273561:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000443f3c4b/0xcd2f56ea038c45f5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ded expref: 3 pid: 8744 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651952.273577:0:6498:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f86c4e7a000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788651952.273589:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651952.273606:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651952.273608:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788651952.273617:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788651952.273931:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125556736 00000100:00100000:2.0:1788651952.273938:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125556736 00000100:00100000:2.0:1788651952.273979:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125556992 00000100:00100000:2.0:1788651952.273982:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125556992 00000100:00100000:2.0:1788651952.273995:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125556864 00000100:00100000:2.0:1788651952.273997:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125556864 00000100:00100000:2.0:1788651952.274023:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:2.0:1788651952.274031:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+15:2390:x1875537125556736:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651952.274043:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651952.274055:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dcc00/0xcd2f56ea038c3ca9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b2a expref: 15 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.274065:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651952.274091:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+14:2390:x1875537125556736:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 62us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651952.274098:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:2.0:1788651952.274112:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:2.0:1788651952.274118:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+13:2390:x1875537125556992:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651952.274134:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651952.274142:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0031200/0xcd2f56ea038c3efc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c03 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.274151:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651952.274166:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:2390:x1875537125556992:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 49us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651952.274172:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:2.0:1788651952.274182:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:2.0:1788651952.274187:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:2390:x1875537125556864:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651952.274193:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651952.274200:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dc200/0xcd2f56ea038c3bec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33aeb expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.274208:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651952.274219:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2390:x1875537125556864:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 32us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651952.274225:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:2.0:1788651952.279776:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651952.280795:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125557504 00000100:00100000:1.0:1788651952.280807:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125557504 00000100:00100000:1.0:1788651952.281138:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 82 00000100:00100000:1.0:1788651952.281149:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2387:x1875537125557504:12345-192.168.204.45@tcp:9:umount.0 00000020:00000080:1.0:1788651952.281176:0:8744:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3fc7 00000100:00080000:1.0:1788651952.281184:0:8744:0:(import.c:65:import_set_state_nolock()) ffff8f85c373b000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788651952.281228:0:8744:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00010000:00010000:0.0:1788651952.281431:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651952.281514:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+2:2387:x1875537125557504:12345-192.168.204.45@tcp:9:umount.0 Request processed in 367us (1747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651952.281522:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 82 00000100:00080000:2.0:1788651952.282255:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651952.288968:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788651952.289088:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125558528 00000100:00100000:3.0:1788651952.289098:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125558528 00000100:00100000:3.0:1788651952.289161:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 258 00000100:00100000:3.0:1788651952.289171:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+22:2387:x1875537125558528:12345-192.168.204.45@tcp:39:umount.0 00000020:00000080:3.0:1788651952.289208:0:12192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3bfa 00000020:00010000:3.0:1788651952.289225:0:12192:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f85c32cd800: total 0 00000100:00080000:3.0:1788651952.289229:0:12192:0:(import.c:65:import_set_state_nolock()) ffff8f85c32cf800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788651952.289261:0:12192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1788651952.289422:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+21:2387:x1875537125558528:12345-192.168.204.45@tcp:39:umount.0 Request processed in 252us (465us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1788651952.289430:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 258 00000020:00010000:2.0:1788651952.289817:0:7452:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f85c32cd800: total 0 00010000:00010000:2.0:1788651952.289880:0:7452:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f85c32cd800, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788651952.289950:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651952.289954:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651952.289964:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906a00/0xcd2f56ea038c45b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33dd8 expref: 20 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290019:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651952.290022:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788651952.290027:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c4967 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ee9 expref: 19 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290041:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:2.0:1788651952.290043:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651952.290047:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907800/0xcd2f56ea038c465e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e09 expref: 18 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290060:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651952.290062:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651952.290066:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f87021f9200/0xcd2f56ea038c4ba5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33f83 expref: 17 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290081:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651952.290084:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788651952.290088:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907e00/0xcd2f56ea038c45e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33de6 expref: 16 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290101:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651952.290103:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788651952.290107:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dd200/0xcd2f56ea038c4298 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33d06 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290119:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86f55f6000) 00010000:00010000:2.0:1788651952.290122:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788651952.290132:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c29dd400/0xcd2f56ea038c3f42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c18 expref: 14 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290154:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f85c3352f00) 00010000:00010000:2.0:1788651952.290156:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788651952.290160:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c3f26 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c11 expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290175:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff8f86c3228400) 00010000:00010000:2.0:1788651952.290177:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788651952.290180:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c467a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33e10 expref: 12 pid: 6509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290196:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff8f85c3368800) 00010000:00010000:2.0:1788651952.290198:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788651952.290202:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c23dda00/0xcd2f56ea038c44d6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33da0 expref: 11 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290216:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651952.290219:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788651952.290222:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b96c00/0xcd2f56ea038c4c85 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fbb expref: 10 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290234:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff8f86c3228900) 00010000:00010000:2.0:1788651952.290237:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788651952.290240:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0906c00/0xcd2f56ea038c4caf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fc9 expref: 9 pid: 6511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290253:0:7452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff8f85c3368400) 00010000:00010000:2.0:1788651952.290264:0:7452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788651952.290268:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f4b97c00/0xcd2f56ea038c3f9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33c2d expref: 8 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651952.290284:0:7452:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f85c32cd800, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1788651952.290298:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651952.290300:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788651952.290302:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651952.300315:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651952.300411:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125558656 00000100:00100000:1.0:1788651952.300421:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125558656 00000100:00100000:1.0:1788651952.300488:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 259 00000100:00100000:1.0:1788651952.300498:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+5:2387:x1875537125558656:12345-192.168.204.45@tcp:39:umount.0 00000020:00000080:1.0:1788651952.300528:0:6510:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3c01 00000100:00080000:1.0:1788651952.300546:0:6510:0:(import.c:65:import_set_state_nolock()) ffff8f86eeabf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788651952.300577:0:6510:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788651952.300739:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:72121fb7-fb91-4477-92d5-4e7fe3e6b65d+3:2387:x1875537125558656:12345-192.168.204.45@tcp:39:umount.0 Request processed in 242us (433us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788651952.300747:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 259 00000100:00080000:2.0:1788651952.301418:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788651952.301484:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651952.608170:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651953.125021:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147626496:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788651953.125109:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651953.125666:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147626496 00000100:00100000:3.0:1788651953.125675:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147626496 00000100:00100000:3.0:1788651953.125735:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788651953.125747:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147626496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788651953.125786:0:6514:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788651953.125867:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147626496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651953.125875:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1788651953.126102:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147626496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788651953.314729:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651953.314835:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651953.315596:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125558912 00000100:00100000:1.0:1788651953.315613:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125558912 00000100:00100000:1.0:1788651953.315699:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 376 00000100:00100000:1.0:1788651953.315711:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2388:x1875537125558912:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788651953.315828:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2388:x1875537125558912:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 117us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651953.315836:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 376 00000100:00100000:3.0:1788651953.318577:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125558784 00000100:00100000:3.0:1788651953.318593:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125558784 00000100:00100000:3.0:1788651953.318664:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 402 00000100:00100000:3.0:1788651953.318674:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2388:x1875537125558784:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788651953.318768:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2388:x1875537125558784:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 95us (4050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651953.318788:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 402 00000100:00080000:2.0:1788651953.319130:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651953.329658:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651953.329811:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125559040 00000100:00100000:1.0:1788651953.329821:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125559040 00000100:00100000:1.0:1788651953.329898:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 377 00000100:00100000:1.0:1788651953.329940:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125559040:12345-192.168.204.45@tcp:400:kworker.0 00000100:00080000:2.0:1788651953.330108:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788651953.330270:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2389:x1875537125559040:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 362us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651953.330279:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 377 00010000:00010000:2.0:1788651953.641423:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651954.656142:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147626624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788651954.656168:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651954.656220:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651954.656414:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651954.656425:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147626752:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788651954.656456:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651954.656564:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147626624 00000100:00100000:0.0:1788651954.656572:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147626624 00000100:00100000:0.0:1788651954.656634:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147626752 00000100:00100000:0.0:1788651954.656637:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147626752 00000100:00100000:0.0:1788651954.656656:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788651954.656664:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147626624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788651954.656710:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788651954.656757:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147626624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651954.656764:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788651954.656783:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788651954.656789:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147626752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788651954.656799:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788651954.656845:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147626752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651954.656850:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788651954.656897:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147626752:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788651954.657054:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788651954.657260:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147626624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788651954.657723:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147626880:0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.657765:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651954.657799:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147627392:0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.657837:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651954.657859:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147627904:0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.657883:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651954.657899:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788651954.657905:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147627264:0@lo:400:kworker.0 00000100:00100000:2.0:1788651954.657948:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147627008:0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.657981:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651954.658003:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651954.658006:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147627776:0@lo:400:kworker.0 00000100:00100000:2.0:1788651954.658037:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147627520:0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.658038:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651954.658071:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651954.658077:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147627392 00000100:00100000:3.0:1788651954.658084:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147627392 00000100:00100000:2.0:1788651954.658094:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147628032:0@lo:400:kworker.0 00000100:00100000:2.0:1788651954.658118:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651954.658132:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788651954.658142:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147627392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651954.658144:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788651954.658153:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147627136:0@lo:400:kworker.0 00000100:00100000:2.0:1788651954.658189:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651954.658200:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147627392:12345-0@lo:400:kworker.0 Request processed in 59us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651954.658208:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788651954.658212:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147627648:0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.658223:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147627136 00000100:00100000:3.0:1788651954.658228:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147627136 00000100:00100000:2.0:1788651954.658237:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651954.658264:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147628160:0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.658265:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788651954.658274:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147627136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651954.658306:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651954.658325:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147627136:12345-0@lo:400:kworker.0 Request processed in 53us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651954.658333:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788651954.658339:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147627136:0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.658363:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147627264 00000100:00100000:3.0:1788651954.658368:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147627264 00000100:00100000:2.0:1788651954.658378:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147627008 00000100:00100000:2.0:1788651954.658383:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147627008 00000100:00100000:3.0:1788651954.658411:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147627520 00000100:00100000:2.0:1788651954.658413:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147628032 00000100:00100000:3.0:1788651954.658417:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147627520 00000100:00100000:2.0:1788651954.658418:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147628032 00000100:00100000:3.0:1788651954.658447:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147627648 00000100:00100000:3.0:1788651954.658452:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147627648 00000100:00100000:2.0:1788651954.658457:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147628160 00000100:00100000:2.0:1788651954.658461:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147628160 00000100:00100000:2.0:1788651954.658480:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788651954.658491:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788651954.658491:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147627264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.658505:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147627008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651954.658535:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147627264:12345-0@lo:400:kworker.0 Request processed in 47us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651954.658543:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788651954.658558:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147627008:12345-0@lo:400:kworker.0 Request processed in 55us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651954.658561:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788651954.658571:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1788651954.658574:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147627520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.658592:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788651954.658602:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147628032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651954.658609:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147627520:12345-0@lo:400:kworker.0 Request processed in 38us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651954.658616:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788651954.658630:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788651954.658638:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147628160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.658656:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147628032:12345-0@lo:400:kworker.0 Request processed in 42us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651954.658665:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:2.0:1788651954.658670:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3635:x1875537147628160:12345-0@lo:400:kworker.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651954.658678:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788651954.658684:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1788651954.658693:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147627648:12345-0@lo:400:kworker.0 00010000:00080000:2.0:1788651954.658726:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d0000 x1875537147628160/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651954.658731:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147627648:12345-0@lo:400:kworker.0 Request processed in 38us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651954.658747:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147628160:0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.658748:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00080000:3.0:1788651954.658772:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788651954.658772:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147627008:0@lo:400:kworker.0 00000100:00100000:2.0:1788651954.658781:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147627520:0@lo:400:kworker.0 00000100:00080000:3.0:1788651954.658785:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788651954.658792:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147628032:0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.658812:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147627264:0@lo:400:kworker.0 00000100:00100000:3.0:1788651954.658825:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147627392:0@lo:400:kworker.0 00010000:00080000:2.0:1788651954.658955:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86f48d2680 x1875537147627648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651954.658976:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147627648:0@lo:400:kworker.0 00000100:00100000:1.0:1788651954.659192:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147627904 00000100:00100000:1.0:1788651954.659197:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147627904 00000100:00100000:1.0:1788651954.659239:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147627776 00000100:00100000:1.0:1788651954.659242:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147627776 00000100:00100000:1.0:1788651954.659265:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788651954.659272:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147627904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651954.659319:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147627904:12345-0@lo:400:kworker.0 Request processed in 48us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651954.659325:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788651954.659338:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788651954.659345:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147627776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651954.659388:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147627776:12345-0@lo:400:kworker.0 Request processed in 43us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651954.659403:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788651954.659415:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147627776:0@lo:400:kworker.0 00000100:00100000:2.0:1788651954.659428:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147627904:0@lo:400:kworker.0 00000100:00100000:0.0:1788651954.659866:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147626880 00000100:00100000:0.0:1788651954.659872:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147626880 00000100:00100000:0.0:1788651954.659945:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1788651954.659955:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147626880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788651954.660023:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3638:x1875537147626880:12345-0@lo:400:kworker.0 Request processed in 71us (2258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651954.660030:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00080000:3.0:1788651954.660359:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788651954.662352:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3638:1875537147626880:0@lo:400:kworker.0 00000100:00100000:0.0:1788651954.871322:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651954.871376:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788651954.871412:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651954.871492:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125559168 00000100:00100000:1.0:1788651954.871503:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125559168 00000100:00100000:2.0:1788651954.871508:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125559296 00000100:00100000:2.0:1788651954.871516:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125559296 00000100:00100000:3.0:1788651954.871605:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125559424 00000100:00100000:3.0:1788651954.871610:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125559424 00000100:00100000:3.0:1788651954.871645:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:3.0:1788651954.871654:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c92d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+12:2389:x1875537125559296:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788651954.871675:0:6497:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651954.871696:0:6497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0031e00/0xcd2f56ea038c3ef5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33bfc expref: 12 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651954.871715:0:6497:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651954.871767:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c92d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:2389:x1875537125559296:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 113us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651954.878725:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:2.0:1788651954.878759:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+11:2388:x1875537125559424:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788651954.878782:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788651954.878806:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4200/0xcd2f56ea038c3cfd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b3f expref: 11 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651954.878828:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788651954.878885:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5181ca9-d102-4cac-a75c-a4c1a36c2137+10:2388:x1875537125559424:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 146us (7472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651954.878894:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:1.0:1788651954.879001:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:1.0:1788651954.879536:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+9:2391:x1875537125559168:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788651954.879567:0:6496:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651954.879580:0:6496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff414400/0xcd2f56ea038c3d04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b70 expref: 9 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651954.879592:0:6496:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651954.879640:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5181ca9-d102-4cac-a75c-a4c1a36c2137+8:2391:x1875537125559168:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 630us (8330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651954.879648:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:1.0:1788651954.886529:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651954.886631:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125559680 00000100:00100000:2.0:1788651954.886645:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125559680 00000100:00100000:2.0:1788651954.886735:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 260 00000100:00100000:2.0:1788651954.886749:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:029f4676-f465-4d1e-a0cb-3243b2e8fb58+6:2387:x1875537125559680:12345-192.168.204.45@tcp:39:umount.0 00000020:00000080:2.0:1788651954.886817:0:12192:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3d12 00000020:00010000:2.0:1788651954.886829:0:12192:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f85c354e000: total 0 00000100:00080000:2.0:1788651954.886834:0:12192:0:(import.c:65:import_set_state_nolock()) ffff8f85c354d000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788651954.886869:0:12192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:0.0:1788651954.887070:0:6499:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f85c354e000: total 0 00010000:00010000:0.0:1788651954.887076:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651954.887102:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2387:x1875537125559680:12345-192.168.204.45@tcp:39:umount.0 Request processed in 355us (582us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1788651954.887110:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 260 00010000:00010000:0.0:1788651954.887139:0:6499:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f85c354e000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788651954.887191:0:6499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368700) 00010000:00010000:0.0:1788651954.887195:0:6499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788651954.887210:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6e00/0xcd2f56ea038c4cd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fd7 expref: 4 pid: 12192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651954.887234:0:6499:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f85c354e000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788651954.887247:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651954.887249:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651954.887251:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651954.889136:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:2.0:1788651954.904321:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788651954.904878:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125559808 00000100:00100000:1.0:1788651954.904890:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125559808 00000100:00100000:1.0:1788651954.905011:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 261 00000100:00100000:1.0:1788651954.905023:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+5:2387:x1875537125559808:12345-192.168.204.45@tcp:39:umount.0 00000020:00000080:1.0:1788651954.905069:0:6511:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3d19 00000100:00080000:1.0:1788651954.905079:0:6511:0:(import.c:65:import_set_state_nolock()) ffff8f85c3182000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788651954.905104:0:6511:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788651954.905391:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:029f4676-f465-4d1e-a0cb-3243b2e8fb58+3:2387:x1875537125559808:12345-192.168.204.45@tcp:39:umount.0 Request processed in 369us (1088us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788651954.905399:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 261 00010000:00010000:0.0:1788651954.905574:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651954.939874:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788651954.940055:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125560064 00000100:00100000:2.0:1788651954.940067:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125560064 00000100:00100000:2.0:1788651954.940127:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 404 00000100:00100000:2.0:1788651954.940139:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+7:2387:x1875537125560064:12345-192.168.204.45@tcp:251:umount.0 00000020:00000080:2.0:1788651954.940198:0:6505:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3bd7 00000020:00010000:2.0:1788651954.940206:0:6505:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f85c32ce800: total 0 00000100:00080000:2.0:1788651954.940211:0:6505:0:(import.c:65:import_set_state_nolock()) ffff8f85c32c9800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788651954.940301:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86e7ce6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5181ca9-d102-4cac-a75c-a4c1a36c2137+3:2387:x1875537125560064:12345-192.168.204.45@tcp:251:umount.0 Request processed in 164us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651954.940310:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 404 00000020:00010000:0.0:1788651954.940421:0:6498:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f85c32ce800: total 0 00010000:00010000:0.0:1788651954.940481:0:6498:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f85c32ce800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788651954.940522:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff415400/0xcd2f56ea038c3cb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33b31 expref: 2 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651954.940552:0:6498:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f85c32ce800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788651954.940565:0:6498:0:(genops.c:885:class_export_put()) final put ffff8f85c32ce800/f5181ca9-d102-4cac-a75c-a4c1a36c2137 00010000:00010000:0.0:1788651954.940584:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651954.940586:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651954.940588:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788651954.941270:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32ce800/f5181ca9-d102-4cac-a75c-a4c1a36c2137 for MGS 00000020:00000080:2.0:1788651954.941319:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c32c9800 for MGS 00000040:00080000:1.0:1788651955.302526:0:13791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788651955.680861:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147628288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788651955.680979:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651955.681279:0:13809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147628288 00000100:00100000:0.0:1788651955.681287:0:13809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147628288 00000100:00100000:0.0:1788651955.681342:0:13809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788651955.681351:0:13809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147628288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788651955.681379:0:13809:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788651955.681442:0:13809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147628288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788651955.681450:0:13809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788651955.681493:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147628288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788651955.682049:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788651955.682990:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651955.683004:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147628416:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788651955.683056:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651955.683243:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147628416 00000100:00100000:1.0:1788651955.683265:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147628416 00000100:00100000:1.0:1788651955.683314:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788651955.683324:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147628416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651955.683344:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651955.683530:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147628416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 207us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651955.683539:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788651955.683578:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147628416:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788651956.578041:0:13788:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788651956.578051:0:13788:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788651956.578138:0:13788:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788651956.578144:0:13788:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788651956.704183:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788651956.704205:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147628544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788651956.704284:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651956.704621:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147628544 00000100:00100000:3.0:1788651956.704632:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147628544 00000100:00100000:3.0:1788651956.704685:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788651956.704695:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147628544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788651956.704730:0:7820:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788651956.704789:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147628544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651956.704796:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00010000:00010000:0.0:1788651956.705008:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651956.705246:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147628544:0@lo:41:osp-pre-1-0.0 00000020:01000004:1.0:1788651956.980618:0:15199:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788651957.000693:0:15199:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788651957.000757:0:15199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.000772:0:15199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.000780:0:15199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.000789:0:15199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.000831:0:15199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788651957.000837:0:15199:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788651957.000872:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788651957.000876:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788651957.000883:0:15199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788651957.000941:0:15199:0:(import.c:65:import_set_state_nolock()) ffff8f86f48dd800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788651957.002974:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651957.002986:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651957.002998:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415a00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651957.003002:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651957.003012:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651957.003019:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651957.003025:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788651957.003028:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788651957.003032:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788651957.003073:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651957.003080:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651957.003112:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651957.003118:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86ff415a00/0xcd2f56ea038c3c7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c86 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651957.003131:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651957.003133:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651957.003135:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651957.003155:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147628672:0@lo:39:umount.0 00000100:00100000:0.0:1788651957.003242:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651957.003479:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147628800:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651957.003516:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651957.003999:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147628800 00000100:00100000:1.0:1788651957.004009:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147628800 00000100:00100000:1.0:1788651957.004060:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788651957.004070:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3636:x1875537147628800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788651957.004084:0:6495:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788651957.004100:0:6495:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dc400/0xcd2f56ea038c3c86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3c7f expref: 24 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.004114:0:6495:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788651957.004150:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:3636:x1875537147628800:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651957.004157:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788651957.004194:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147628800:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651957.005305:0:10110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147628672 00000100:00100000:3.0:1788651957.005316:0:10110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147628672 00000100:00100000:3.0:1788651957.005363:0:10110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788651957.005384:0:10110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875537147628672:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788651957.005411:0:10110:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c37f5 00000100:00080000:3.0:1788651957.005418:0:10110:0:(import.c:65:import_set_state_nolock()) ffff8f86ea13a000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788651957.005489:0:10110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3634:x1875537147628672:12345-0@lo:39:umount.0 Request processed in 106us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651957.005496:0:10110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:3.0:1788651957.005503:0:10110:0:(genops.c:885:class_export_put()) final put ffff8f86d11b4000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788651957.005522:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788651957.005531:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d11b4000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788651957.005773:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86ea13a000 for lustre-MDT0000 00000100:00080000:3.0:1788651957.005807:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f48dd800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788651957.005825:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147628672:0@lo:39:umount.0 00000100:00080000:1.0:1788651957.005884:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788651957.005888:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788651957.005892:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788651957.007069:0:15199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007105:0:15199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007111:0:15199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007118:0:15199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007142:0:15199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788651957.007150:0:15199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007157:0:15199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007162:0:15199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007168:0:15199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007187:0:15199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788651957.007193:0:15199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007199:0:15199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007214:0:15199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007219:0:15199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007230:0:15199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788651957.007235:0:15199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502000/0xcd2f56ea038c374d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007241:0:15199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502000/0xcd2f56ea038c374d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007247:0:15199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502000/0xcd2f56ea038c374d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007253:0:15199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86c1502000/0xcd2f56ea038c374d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651957.007261:0:15199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788651957.007263:0:15199:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788651957.007293:0:15199:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788651957.007298:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788651957.007302:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651957.007307:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1788651957.007312:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f85c2adf800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788651957.007318:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f85c210d800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788651957.007322:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f86edd6d000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788651957.007332:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8f86c8bb6000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:1.0:1788651957.007339:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8f85c354e000 029f4676-f465-4d1e-a0cb-3243b2e8fb58 192.168.204.45@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788651957.007343:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8f85c32cd800 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 192.168.204.45@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:1.0:1788651957.007348:0:15199:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8f86da6c4d40) has exports, disconnecting them 00000020:00080000:1.0:1788651957.007352:0:15199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f85c2adf800), last request at 1788651954 00000020:00000080:1.0:1788651957.007358:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3afe 00010000:00010000:3.0:1788651957.007476:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788651957.007483:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007491:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414a00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651957.007495:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007502:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651957.007510:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651957.007517:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651957.007520:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788651957.007528:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:3.0:1788651957.007562:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007569:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651957.007594:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007601:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86ff414a00/0xcd2f56ea038c3c8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c94 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007617:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788651957.007620:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007626:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651957.007630:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007637:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651957.007644:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651957.007649:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651957.007651:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1788651957.007653:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788651957.007665:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007671:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651957.007684:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007690:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1502200/0xcd2f56ea038c3b91 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3b98 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007700:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788651957.007703:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007709:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651957.007712:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007718:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651957.007724:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651957.007729:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788651957.007731:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788651957.007733:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788651957.007747:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007753:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651957.007768:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007775:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86ff415e00/0xcd2f56ea038c3ee7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3eee expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007796:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651957.007799:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1502000/0xcd2f56ea038c374d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007804:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651957.007807:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502000/0xcd2f56ea038c374d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007814:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1502000/0xcd2f56ea038c374d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651957.007820:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502000/0xcd2f56ea038c374d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651957.007825:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651957.007827:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788651957.007828:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788651957.007841:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c1502000/0xcd2f56ea038c374d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007847:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788651957.007853:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502000/0xcd2f56ea038c374d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007859:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1502000/0xcd2f56ea038c374d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3754 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.007868:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651957.007870:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651957.007876:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651957.007893:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147628928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651957.007983:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651957.008031:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788651957.008038:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147629056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651957.008059:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651957.008089:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147629184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651957.008110:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651957.008127:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788651957.008131:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147629312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651957.008149:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651957.008179:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147628928 00000100:00100000:3.0:1788651957.008185:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147628928 00000100:00100000:3.0:1788651957.008217:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147629056 00000100:00100000:3.0:1788651957.008220:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147629056 00000100:00100000:3.0:1788651957.008231:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147629184 00000100:00100000:3.0:1788651957.008233:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147629184 00000100:00100000:3.0:1788651957.008242:0:7919:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147629312 00000100:00100000:3.0:1788651957.008245:0:7919:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147629312 00000100:00100000:3.0:1788651957.008258:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788651957.008266:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+26:3637:x1875537147628928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651957.008278:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651957.008292:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4000/0xcd2f56ea038c3c94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3c8d expref: 26 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.008306:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651957.008339:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+25:3637:x1875537147628928:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651957.008346:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788651957.008452:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788651957.008459:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+24:3637:x1875537147629056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651957.008467:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651957.008477:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23dce00/0xcd2f56ea038c3b98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3b91 expref: 24 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.008486:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651957.008509:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+23:3637:x1875537147629056:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651957.008515:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788651957.008526:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788651957.008531:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+22:3635:x1875537147629184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651957.008537:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651957.008545:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff415200/0xcd2f56ea038c3eee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3ee7 expref: 22 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.008553:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651957.008577:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+21:3635:x1875537147629184:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651957.008583:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788651957.008593:0:7919:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788651957.008598:0:7919:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+20:3635:x1875537147629312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788651957.008604:0:7919:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788651957.008613:0:7919:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c3754 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c374d expref: 20 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651957.008621:0:7919:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788651957.008646:0:7919:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1387a7f4-5194-4c3d-9855-aa6dad12ca23+19:3635:x1875537147629312:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651957.008652:0:7919:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1788651957.008677:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651957.008698:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147629312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651957.008706:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147629184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651957.008727:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147629056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651957.008734:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147628928:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788651957.008821:0:15199:0:(import.c:65:import_set_state_nolock()) ffff8f85c2ad8800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788651957.008878:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c2adf800): rc 0 00000020:00000080:1.0:1788651957.008881:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f85c2adf800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788651957.008890:0:15199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f85c210d800), last request at 1788651954 00000020:00000080:1.0:1788651957.008896:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c39d8 00000100:00080000:1.0:1788651957.008902:0:15199:0:(import.c:65:import_set_state_nolock()) ffff8f85c2108800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788651957.008938:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c210d800): rc 0 00000020:00000080:1.0:1788651957.008940:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f85c210d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:1.0:1788651957.008945:0:15199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f86edd6d000), last request at 1788651712 00000020:00000080:1.0:1788651957.008948:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c38d5 00000100:00080000:1.0:1788651957.008951:0:15199:0:(import.c:65:import_set_state_nolock()) ffff8f86edd6c000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788651957.008956:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f86edd6d000): rc 0 00000020:00000080:1.0:1788651957.008958:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86edd6d000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:1.0:1788651957.008961:0:15199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8f86c8bb6000), last request at 1788651712 00000020:00000080:1.0:1788651957.008964:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c38a4 00000100:00080000:1.0:1788651957.008967:0:15199:0:(import.c:65:import_set_state_nolock()) ffff8f86f49d8800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788651957.008973:0:15199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000020:00080000:1.0:1788651957.009042:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f86c8bb6000): rc 0 00000004:00000080:1.0:1788651957.009048:0:15199:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa71c01c97ae0 00000100:00080000:1.0:1788651957.009065:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788651957.009074:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:0.0:1788651957.010489:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788651957.010584:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2adf800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788651957.010655:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c210d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788651957.010680:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd6d000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788651957.010711:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c2ad8800 for lustre-MDT0000 00000020:00000080:3.0:1788651957.010716:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c2108800 for lustre-MDT0000 00000020:00000080:3.0:1788651957.010719:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86edd6c000 for lustre-MDT0000 00010000:00010000:3.0:1788651957.010729:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651957.010734:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788651957.010896:0:15199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788651957.011038:0:15199:0:(import.c:65:import_set_state_nolock()) ffff8f86f49db800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788651957.011083:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147629440:0@lo:39:umount.0 00000100:00100000:3.0:1788651957.011148:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651957.011219:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147629440 00000100:00100000:0.0:1788651957.011227:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147629440 00000100:00100000:0.0:1788651957.011284:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788651957.011293:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875537147629440:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788651957.011317:0:6514:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3930 00000100:00080000:0.0:1788651957.011325:0:6514:0:(import.c:65:import_set_state_nolock()) ffff8f86ee84f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788651957.011345:0:6514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:1.0:1788651957.015387:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788651957.015395:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:1.0:1788651957.015417:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788651957.015480:0:15199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788651957.015507:0:15199:0:(import.c:65:import_set_state_nolock()) ffff8f85c2925800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788651957.015696:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147629568:0@lo:9:umount.0 00000100:00100000:3.0:1788651957.015765:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651957.015841:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147629568 00000100:00100000:2.0:1788651957.015850:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147629568 00000100:00100000:2.0:1788651957.015934:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788651957.015945:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3634:x1875537147629568:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788651957.015972:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3a8e 00000100:00080000:2.0:1788651957.015981:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f1800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788651957.016025:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1788651957.016150:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3634:x1875537147629568:12345-0@lo:9:umount.0 Request processed in 206us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651957.016158:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1788651957.017519:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788651957.020821:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3634:x1875537147629440:12345-0@lo:39:umount.0 Request processed in 9516us (9660us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788651957.020837:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00010000:00010000:0.0:1788651957.020887:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788651957.023555:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788651957.023565:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1788651957.023590:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788651957.023645:0:15199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788651957.023684:0:15199:0:(import.c:65:import_set_state_nolock()) ffff8f85c32cf000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788651957.023745:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8f86da6c4d40) has no exports 00000100:00080000:3.0:1788651957.024883:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f49db800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788651957.024897:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3711880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147629440:0@lo:39:umount.0 00000100:00100000:3.0:1788651957.024955:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147629696:0@lo:9:umount.0 00000100:00100000:3.0:1788651957.025025:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788651957.025090:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c2925800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788651957.025104:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788651957.025108:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788651957.025113:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147629568:0@lo:9:umount.0 00000100:00100000:3.0:1788651957.025161:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147629696 00000100:00100000:3.0:1788651957.025168:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147629696 00000100:00100000:3.0:1788651957.025233:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788651957.025245:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3634:x1875537147629696:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788651957.025273:0:8744:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3bd0 00000100:00080000:3.0:1788651957.025284:0:8744:0:(import.c:65:import_set_state_nolock()) ffff8f85c3549000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788651957.025328:0:8744:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00080000:1.0:1788651957.025976:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788651957.025999:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651957.027476:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3634:x1875537147629696:12345-0@lo:9:umount.0 Request processed in 2229us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651957.027488:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00010000:3.0:1788651957.027530:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788651957.031752:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c32cf000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788651957.031841:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788651957.042799:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788651957.042817:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147629696:0@lo:9:umount.0 00000020:00080000:2.0:1788651957.059791:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8f86da6c4d40) has no exports 00000020:00000080:2.0:1788651957.137040:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c37a8 00000020:00000080:2.0:1788651957.137057:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86ea18a800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788651957.137075:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788651957.137310:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea18a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788651957.137334:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788651957.137344:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788651957.137348:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8f86fb2499c0) has no exports 00000020:00000080:3.0:1788651957.140100:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c37a1 00000020:00000080:3.0:1788651957.140118:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86ea18d800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788651957.142889:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea18d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788651957.144069:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788651957.144082:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788651957.144089:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86ea18b000/lustre-QMT0000_UUID 00000020:00000080:2.0:1788651957.144093:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea18b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1788651957.144099:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1788651957.728689:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651958.240766:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788651958.240791:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147629824:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788651958.240869:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651958.241307:0:6515:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147629824 00000100:00100000:2.0:1788651958.241317:0:6515:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147629824 00000100:00100000:2.0:1788651958.241367:0:6515:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1788651958.241375:0:6515:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875537147629824:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788651958.241383:0:6515:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788651958.241428:0:6515:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3638:x1875537147629824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 53us (559us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788651958.241435:0:6515:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:02020000:0.0:1788651958.241662:0:3638:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000001:00100000:3.0:1788651958.247424:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788651958.247434:0:8422:0:(genops.c:885:class_export_put()) final put ffff8f85c19f0800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788651958.247465:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:3.0:1788651958.247468:0:8422:0:(genops.c:885:class_export_put()) final put ffff8f85c373f800/72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:1.0:1788651958.247552:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c19f0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788651958.247608:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c373f800/72121fb7-fb91-4477-92d5-4e7fe3e6b65d for lustre-OST0000 00000020:00000080:1.0:1788651958.247627:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c19f1800 for lustre-OST0000 00000020:00000080:1.0:1788651958.247632:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c373b000 for lustre-OST0000 00000100:00080000:0.0:1788651958.255394:0:3638:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788651958.255402:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8f86f095e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788651958.255406:0:3638:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000001:00100000:3.0:1788651958.263513:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788651958.263541:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788651958.263547:0:7440:0:(genops.c:885:class_export_put()) final put ffff8f86ee84d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788651958.263575:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000001:00080000:3.0:1788651958.263583:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788651958.263585:0:7440:0:(genops.c:885:class_export_put()) final put ffff8f85c3184000/029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000001:00100000:3.0:1788651958.263591:0:7440:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000001:00080000:3.0:1788651958.263594:0:7440:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788651958.263595:0:7440:0:(genops.c:885:class_export_put()) final put ffff8f85c32cc800/72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:1.0:1788651958.264079:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ee84d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:1.0:1788651958.264142:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c3184000/029f4676-f465-4d1e-a0cb-3243b2e8fb58 for lustre-MDT0001 00000020:00000080:1.0:1788651958.264165:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32cc800/72121fb7-fb91-4477-92d5-4e7fe3e6b65d for lustre-MDT0001 00000020:00000080:1.0:1788651958.264190:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86ee84f800 for lustre-MDT0001 00000020:00000080:1.0:1788651958.264209:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3182000 for lustre-MDT0001 00000020:00000080:1.0:1788651958.264213:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86eeabf800 for lustre-MDT0001 00000001:00100000:3.0:1788651958.264664:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788651958.264669:0:6489:0:(genops.c:885:class_export_put()) final put ffff8f86c8bb6000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788651958.264685:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000001:00080000:3.0:1788651958.264691:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:3.0:1788651958.264693:0:6489:0:(genops.c:885:class_export_put()) final put ffff8f85c354e000/029f4676-f465-4d1e-a0cb-3243b2e8fb58 00000001:00100000:3.0:1788651958.264698:0:6489:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000001:00080000:3.0:1788651958.264703:0:6489:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:3.0:1788651958.264712:0:6489:0:(genops.c:885:class_export_put()) final put ffff8f85c32cd800/72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:1.0:1788651958.269269:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c8bb6000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788651958.269354:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c354e000/029f4676-f465-4d1e-a0cb-3243b2e8fb58 for lustre-MDT0000 00000020:00000080:1.0:1788651958.269379:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32cd800/72121fb7-fb91-4477-92d5-4e7fe3e6b65d for lustre-MDT0000 00000020:00000080:1.0:1788651958.269406:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86f49d8800 for lustre-MDT0000 00000020:00000080:1.0:1788651958.269411:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c354d000 for lustre-MDT0000 00000020:00000080:1.0:1788651958.269414:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c32cf800 for lustre-MDT0000 00000001:00100000:2.0:1788651958.269570:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788651958.269576:0:9506:0:(genops.c:885:class_export_put()) final put ffff8f85c354d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788651958.269598:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:2.0:1788651958.269601:0:9506:0:(genops.c:885:class_export_put()) final put ffff8f86c4e7a000/72121fb7-fb91-4477-92d5-4e7fe3e6b65d 00000020:00000080:3.0:1788651958.269676:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c354d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788651958.269704:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c4e7a000/72121fb7-fb91-4477-92d5-4e7fe3e6b65d for lustre-OST0001 00000020:00000080:3.0:1788651958.269723:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3549000 for lustre-OST0001 00000020:00000080:3.0:1788651958.269728:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86c4e7b800 for lustre-OST0001 00000100:00080000:0.0:1788651958.277649:0:3638:0:(import.c:65:import_set_state_nolock()) ffff8f86f095e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788651958.277665:0:3638:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 168 00000100:00080000:0.0:1788651958.277676:0:3638:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f86f095e000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788651958.277753:0:3638:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d0380 x1875537147629952/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788651958.278727:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147629952:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788651958.278804:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651958.278955:0:6514:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147629952 00000100:00100000:2.0:1788651958.278966:0:6514:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147629952 00000100:00100000:2.0:1788651958.279015:0:6514:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788651958.279023:0:6514:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147629952:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788651958.279042:0:6514:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788651958.286744:0:6514:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147629952:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 7712us (7931us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788651958.286757:0:6514:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00080000:3.0:1788651958.286873:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f095e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788651958.286879:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788651958.286883:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147629952:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:1.0:1788651958.753235:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788651959.200152:0:15199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f85c2bf1b40 - data ffff8f86f8728e58/ffff8f86ea1ca400 00000020:01000000:2.0:1788651959.200350:0:15199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86f48c9f00 - data ffff8f86f8588798/ffff8f86f4aa3400 00000001:00000004:2.0:1788651959.208745:0:15199:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:3.0:1788651959.268720:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788651959.268743:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788651959.268761:0:15199:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8f85c3711880 x1875537147629440/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788651967 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651959.268787:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788651959.271997:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788651959.272005:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:0.0:1788651959.272034:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788651959.272037:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788651959.274645:0:8741:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788651959.274653:0:8741:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1788651959.274666:0:8741:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788651959.275338:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788651959.275344:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788651959.275368:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788651959.275370:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788651959.276092:0:9837:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788651959.276097:0:9837:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788651959.276108:0:9837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788651959.277556:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3770 00000020:00000080:0.0:1788651959.277567:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86ea1e0000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788651959.278019:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea1e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788651959.281722:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3785 00000020:00000080:0.0:1788651959.281738:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86ea1e3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788651959.281759:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788651959.281765:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651959.281774:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788651959.281779:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8f86da6c19c0) has no exports 00000004:01000000:0.0:1788651959.282125:0:15199:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788651959.282135:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3bbb 00000020:00000080:0.0:1788651959.282141:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f85c2ada000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788651959.282146:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788651959.282149:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651959.282158:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788651959.282161:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff8f85c2ae19c0) has no exports 00000020:00000080:0.0:1788651959.282167:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3bb4 00000020:00000080:0.0:1788651959.282170:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f85c196b800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788651959.282566:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea1e3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788651959.282661:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2ada000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788651959.282668:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c196b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788651959.284528:0:15199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788651959.284535:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788651959.284539:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:0.0:1788651959.284547:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788651959.284550:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788651959.284605:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651959.284620:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788651959.284630:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3a79 00000020:00000080:0.0:1788651959.284637:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f85c2924800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788651959.284644:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788651959.284660:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651959.284666:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788651959.284670:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8f85c2930000) has no exports 00000020:00000080:0.0:1788651959.284677:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3a72 00000020:00000080:0.0:1788651959.284681:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f85c2921000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1788651959.285059:0:15199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788651959.285095:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788651959.285098:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:0.0:1788651959.285102:0:15199:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788651959.285104:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788651959.285297:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651959.285305:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:0.0:1788651959.285320:0:15199:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:0.0:1788651959.285327:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3929 00000020:00000080:0.0:1788651959.285331:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86eea85800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788651959.285335:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:0.0:1788651959.285348:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651959.285352:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788651959.285355:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8f86c8db0000) has no exports 00000020:00000080:0.0:1788651959.285360:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3922 00000020:00000080:0.0:1788651959.285363:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86f49db000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788651959.286594:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c32cf000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788651959.286610:0:8:0:(genops.c:885:class_export_put()) final put ffff8f85c2add000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788651959.286614:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2add000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788651959.286622:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788651959.286710:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2924800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788651959.286717:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2921000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788651959.286723:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c2925800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788651959.286729:0:8:0:(genops.c:885:class_export_put()) final put ffff8f85c2924000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788651959.286730:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2924000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788651959.286733:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788651959.286764:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86eea85800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788651959.286782:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f49db000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788651959.286826:0:15199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:1.0:1788651959.286830:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788651959.286833:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:1.0:1788651959.286839:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788651959.286882:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651959.286892:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788651959.286937:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651959.286941:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788651959.286944:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86ea13f800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788651959.286946:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea13f800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788651959.286950:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788651959.286963:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86f49db800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788651959.286973:0:8:0:(genops.c:885:class_export_put()) final put ffff8f86c8bb1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788651959.286976:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c8bb1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1788651959.286989:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788651959.287018:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c378c 00000020:00000080:1.0:1788651959.287030:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86ea1e6800/lustre-MDD0000_UUID 00000020:01000000:1.0:1788651959.287042:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788651959.287046:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651959.287051:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788651959.287055:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8f86ea1f19c0) has no exports 00000020:00000080:3.0:1788651959.287061:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea1e6800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788651959.287080:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651959.287086:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788651959.287090:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86ea1e4000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788651959.287092:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea1e4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788651959.287097:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788651959.287127:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3793 00000020:00000080:1.0:1788651959.287132:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86ea1e2800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788651959.287154:0:15199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86da667000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788651959.287158:0:15199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86da667000 3 00000020:01000004:1.0:1788651959.287161:0:15199:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f86da667000 from lustre-MDT0000 00000020:00000080:1.0:1788651959.287182:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651959.287185:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788651959.287188:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86ea1e6000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788651959.287196:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea1e6000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788651959.287203:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:3.0:1788651959.287220:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea1e2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1788651959.287239:0:15199:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:1.0:1788651959.287245:0:15199:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788651959.287248:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788651959.287250:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651959.287253:0:15199:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788651959.287259:0:15199:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8f86da664000 1387a7f4-5194-4c3d-9855-aa6dad12ca23 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788651959.287264:0:15199:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8f86c8db19c0) has exports, disconnecting them 00000020:00080000:1.0:1788651959.287267:0:15199:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8f86da664000), last request at 1788651689 00000020:00000080:1.0:1788651959.287280:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3731 00000020:00010000:1.0:1788651959.287284:0:15199:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8f86da664000: total 0 00000100:00080000:1.0:1788651959.287288:0:15199:0:(import.c:65:import_set_state_nolock()) ffff8f86da663800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788651959.287309:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f86da664000): rc 0 00000020:00080000:1.0:1788651959.287314:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8f86c8db19c0) has no exports 00000020:00010000:3.0:1788651959.287332:0:7452:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8f86da664000: total 0 00010000:00010000:3.0:1788651959.287360:0:7452:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8f86da664000, canceled 0 locks, left on hash table 13. 00000100:00100000:1.0:1788651959.287388:0:6502:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8f86c392f400:6502] 0 exiting: rc = 1 00010000:00010000:3.0:1788651959.287396:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c23ddc00/0xcd2f56ea038c3c6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3c63 expref: 14 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287417:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4e00/0xcd2f56ea038c3c5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3c55 expref: 13 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287430:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f8e00/0xcd2f56ea038c383b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3834 expref: 12 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287449:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff414000/0xcd2f56ea038c3ec4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3ebd expref: 11 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287462:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0031800/0xcd2f56ea038c3ed2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3ecb expref: 10 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287489:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff414600/0xcd2f56ea038c3c78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3c71 expref: 9 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287501:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c382d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3826 expref: 8 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651959.287506:0:6505:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8f86d289e400:6505] 2 exiting: rc = 0 00010000:00010000:3.0:1788651959.287518:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff415600/0xcd2f56ea038c3ca2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3c9b expref: 7 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287532:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c3c32 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3c2b expref: 6 pid: 6505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287545:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86c0030400/0xcd2f56ea038c3ee0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3ed9 expref: 5 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287564:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da5a00/0xcd2f56ea038c3c40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3c39 expref: 4 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287574:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86ff414200/0xcd2f56ea038c3b52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3b4b expref: 3 pid: 6502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287585:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4400/0xcd2f56ea038c3c4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xcd2f56ea038c3c47 expref: 2 pid: 6504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651959.287595:0:7452:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8f86da664000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788651959.287610:0:7452:0:(genops.c:885:class_export_put()) final put ffff8f86da664000/1387a7f4-5194-4c3d-9855-aa6dad12ca23 00010000:00010000:3.0:1788651959.287628:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651959.287630:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651959.287631:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651959.287667:0:6504:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8f86d289e200:6504] 1 exiting: rc = 0 00000020:00000080:1.0:1788651959.290311:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86da664000/1387a7f4-5194-4c3d-9855-aa6dad12ca23 for MGS 00000020:00000080:1.0:1788651959.290361:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86da663800 for MGS 00000100:00100000:1.0:1788651959.290418:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290428:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290435:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290440:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290447:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290452:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290458:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290464:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290469:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290475:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290481:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290487:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290493:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290514:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290520:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290525:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290531:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290536:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290542:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290547:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290554:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290561:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290568:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290573:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290580:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290585:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290591:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290596:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290602:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290608:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290613:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290620:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290625:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290631:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290636:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290641:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290647:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290652:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290658:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290663:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290669:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290674:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290679:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290684:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290689:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290694:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290699:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290704:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290717:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290723:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290729:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290735:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290740:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290746:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290752:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290767:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290774:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290778:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290784:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290790:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290795:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290800:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290806:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651959.290812:0:15199:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788651959.303107:0:15199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f85c2bf1f60 - data ffff8f86f87281b0/ffff8f86ea1c8000 00000020:01000000:1.0:1788651959.303500:0:15199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86c6002060 - data ffff8f86f8414d80/ffff8f86fb1d0c00 00000020:00000080:1.0:1788651959.305681:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3715 00000020:00000080:1.0:1788651959.305697:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86d099a000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788651959.306289:0:15199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86da667000 from MGS, refs=2 00000020:01000004:1.0:1788651959.306295:0:15199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86da667000 2 00000020:01000004:1.0:1788651959.306298:0:15199:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f86da667000 from MGS 00000020:00000080:1.0:1788651959.306329:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651959.306339:0:15199:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788651959.306343:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86d099e000/MGS 00000020:00000080:1.0:1788651959.306347:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d099e000/MGS for MGS 00000020:01000000:1.0:1788651959.306361:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788651959.306455:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788651959.306459:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651959.306464:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788651959.306472:0:15199:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8f86f48df000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788651959.306478:0:15199:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8f86c8db4d40) has exports, disconnecting them 00000020:00080000:1.0:1788651959.306492:0:15199:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8f86f48df000), last request at 1788651689 00000020:00000080:1.0:1788651959.306497:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c37e0 00000020:00080000:1.0:1788651959.306509:0:15199:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f86f48df000): rc 0 00000020:00000080:1.0:1788651959.306513:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86f48df000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788651959.308482:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d099a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788651959.313084:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f48df000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1788651959.320975:0:15199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1788651959.320984:0:15199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788651959.320988:0:15199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788651959.320995:0:15199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788651959.321027:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86f48dd800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788651959.321181:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788651959.321190:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788651959.321196:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86c8bb7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788651959.321199:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c8bb7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788651959.321209:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788651959.321286:0:15199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86da667000 1 00000020:00000080:3.0:1788651959.321293:0:15199:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3707 00000020:00000080:3.0:1788651959.321300:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86d099f000/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788651959.321309:0:15199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788651959.321317:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d099f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788651959.321326:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788651959.321330:0:15199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788651959.321334:0:15199:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8f86fb248000) has no exports 00000020:00000080:3.0:1788651959.591557:0:15199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788651959.591570:0:15199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1788651959.591576:0:15199:0:(genops.c:885:class_export_put()) final put ffff8f86da662000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788651959.591581:0:15199:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86da662000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788651959.591587:0:15199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1788651959.591706:0:15199:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f86da660000 00000020:02000400:3.0:1788651959.591771:0:15199:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:2.0:1788651959.776334:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147630080:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788651959.776422:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651959.776506:0:8431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147630080 00000100:00100000:2.0:1788651959.776513:0:8431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147630080 00000100:00080000:0.0:1788651959.776651:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788651959.776655:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788651959.776659:0:8:0:(import.c:65:import_set_state_nolock()) ffff8f86f095e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788651959.776733:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 414 00000100:00080000:0.0:1788651959.776741:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788651959.776748:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f86f095e000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788651959.776775:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d1f80 x1875537147630336/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788651959.776959:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147630208:0@lo:400:kworker.0 00000400:00000100:0.0:1788651959.776994:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875537147630208 offset 0 length 224: 4 00000100:00100000:2.0:1788651959.777165:0:8431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788651959.777357:0:8431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147630080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788651959.777389:0:8431:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788651959.777434:0:8431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147630080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 260us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651959.777442:0:8431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1788651959.777469:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788651959.777636:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147630848:0@lo:400:kworker.0 00000100:00100000:0.0:1788651959.777748:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651959.777783:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788651959.777790:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147630464:0@lo:400:kworker.0 00000100:00100000:2.0:1788651959.778790:0:8427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147630848 00000100:00100000:0.0:1788651959.778898:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651959.778946:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147630976:0@lo:400:kworker.0 00000100:00100000:0.0:1788651959.778980:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651959.779017:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147630336:0@lo:38:kworker.0 00000100:00100000:0.0:1788651959.779047:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651959.779080:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651959.779091:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147630464 00000100:00100000:0.0:1788651959.779097:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147630464 00000100:00100000:0.0:1788651959.779139:0:6511:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147630976 00000100:00100000:0.0:1788651959.779141:0:6511:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147630976 00000100:00100000:0.0:1788651959.779160:0:6511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788651959.779166:0:6511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1875537147630464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651959.779258:0:8427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147630848 00000100:00100000:2.0:1788651959.779302:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788651959.779309:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147630848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788651959.779361:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147630848:12345-0@lo:400:kworker.0 Request processed in 54us (1614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788651959.779369:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788651959.779392:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788651959.779397:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1875537147630976:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788651959.779403:0:12192:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788651959.779431:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3635:x1875537147630976:12345-0@lo:400:kworker.0 Request processed in 33us (453us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788651959.779437:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1788651959.779460:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:0.0:1788651959.780327:0:6511:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788651959.780370:0:6511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3635:x1875537147630464:12345-0@lo:400:kworker.0 Request processed in 1202us (1471us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788651959.780377:0:6511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788651959.780407:0:7820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147630336 00000100:00100000:0.0:1788651959.780412:0:7820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147630336 00000100:00100000:0.0:1788651959.780482:0:7820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788651959.780487:0:7820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875537147630336:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788651959.780507:0:7820:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788651959.780550:0:7820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3634:x1875537147630336:12345-0@lo:38:kworker.0 Request processed in 61us (1502us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788651959.780567:0:7820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788651959.782517:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147630592:0@lo:400:kworker.0 00000100:00100000:1.0:1788651959.782613:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651959.782650:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147631104:0@lo:400:kworker.0 00000100:00100000:1.0:1788651959.782678:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651959.782705:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651959.782712:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147630720:0@lo:400:kworker.0 00000100:00100000:1.0:1788651959.783013:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651959.783103:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147630592 00000100:00100000:1.0:1788651959.783111:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147630592 00000100:00100000:1.0:1788651959.783148:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147631104 00000100:00100000:1.0:1788651959.783152:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147631104 00000100:00100000:1.0:1788651959.783182:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147630720 00000100:00100000:1.0:1788651959.783184:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147630720 00000100:00100000:1.0:1788651959.783199:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788651959.783206:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147631104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651959.783259:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147631104:12345-0@lo:400:kworker.0 Request processed in 53us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651959.783267:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788651959.783531:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788651959.783540:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147630720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788651959.783708:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147630720:12345-0@lo:400:kworker.0 Request processed in 169us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651959.783715:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788651959.783964:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788651959.783970:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875537147630592:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788651959.783977:0:6510:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788651959.784006:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3637:x1875537147630592:12345-0@lo:400:kworker.0 Request processed in 35us (1393us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788651959.784012:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788651959.784091:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147630080:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1788651959.784132:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f86f48d3480 x1875537147630720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651959.784142:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147630720:0@lo:400:kworker.0 00000100:00080000:1.0:1788651959.784152:0:3637:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788651959.784157:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8f85c210e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788651959.784160:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788651959.785661:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788651959.787932:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f095e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788651959.787945:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788651959.787950:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147630336:0@lo:38:kworker.0 00000100:00080000:0.0:1788651959.788243:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788651959.788248:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8f86ee84e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788651959.788251:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788651959.788256:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8f86ee84e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788651959.788261:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 168 00000100:00080000:0.0:1788651959.788270:0:3635:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f86ee84e800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788651959.788304:0:3635:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d1f80 x1875537147631232/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788651959.788324:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147630464:0@lo:400:kworker.0 00000100:00080000:0.0:1788651959.788338:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788651959.788341:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8f85c3181800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788651959.788344:0:3635:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788651959.788346:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8f85c3181800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788651959.788349:0:3635:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 214 00000100:00080000:0.0:1788651959.788353:0:3635:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f85c3181800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788651959.788364:0:3635:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d0000 x1875537147631360/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788651959.788389:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147630976:0@lo:400:kworker.0 00000100:00100000:0.0:1788651959.788410:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147630848:0@lo:400:kworker.0 00000100:00100000:0.0:1788651959.788435:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147631232:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788651959.788499:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651959.788530:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147631360:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788651959.788550:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651959.794092:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147631232 00000100:00100000:2.0:1788651959.794107:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147631232 00000100:00100000:2.0:1788651959.794154:0:6509:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147631360 00000100:00100000:2.0:1788651959.794224:0:6509:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147631360 00000100:00100000:2.0:1788651959.794248:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788651959.794256:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147631232:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788651959.794278:0:6509:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788651959.794357:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147631232:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 101us (5857us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788651959.794365:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788651959.794380:0:6509:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788651959.794384:0:6509:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147631360:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:2.0:1788651959.794394:0:6509:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788651959.794426:0:6509:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147631360:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 40us (5875us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788651959.794432:0:6509:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1788651959.794875:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86ee84e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788651959.794882:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788651959.794886:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147631232:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788651959.794898:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3181800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788651959.794901:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788651959.794904:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147631360:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:1.0:1788651959.801564:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8f85c210e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788651959.801578:0:3637:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 190 00000100:00080000:1.0:1788651959.801588:0:3637:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f85c210e800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788651959.801660:0:3637:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c3459180 x1875537147631488/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788651959.801693:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147630592:0@lo:400:kworker.0 00010000:00080000:1.0:1788651959.801724:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff8f86f48d2680 x1875537147631104/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651959.801735:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147631104:0@lo:400:kworker.0 00000100:00100000:0.0:1788651959.801877:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147631488:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788651959.801968:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788651959.802131:0:12192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147631488 00000100:00100000:2.0:1788651959.802138:0:12192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147631488 00000100:00100000:2.0:1788651959.802185:0:12192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788651959.802193:0:12192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875537147631488:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:2.0:1788651959.802213:0:12192:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788651959.802265:0:12192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3634:x1875537147631488:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 71us (297us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788651959.802273:0:12192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:1.0:1788651959.802282:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c210e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788651959.802295:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788651959.802299:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147631488:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:1.0:1788651960.800395:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788651960.800422:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147631616:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788651960.800499:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651960.800564:0:8430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147631616 00000100:00100000:1.0:1788651960.800572:0:8430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147631616 00000100:00100000:1.0:1788651960.800635:0:8430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788651960.800649:0:8430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147631616:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788651960.800681:0:8430:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788651960.800734:0:8430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147631616:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788651960.800741:0:8430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00010000:1.0:1788651960.800764:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651960.800833:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147631616:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788651961.826967:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651962.851542:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651963.880529:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788651963.906520:0:15400:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788651963.917052:0:15400:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788651963.917113:0:15400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.917138:0:15400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.917147:0:15400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.917155:0:15400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.917200:0:15400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788651963.917206:0:15400:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788651963.917238:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788651963.917242:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788651963.917248:0:15400:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788651963.917253:0:15400:0:(import.c:65:import_set_state_nolock()) ffff8f86ee84e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788651963.917258:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788651963.917260:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788651963.917263:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788651963.917321:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651963.917330:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.917338:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651963.917415:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.917435:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651963.917441:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651963.917447:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788651963.917449:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788651963.917452:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788651963.917489:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.917495:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651963.917520:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.917526:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4c00/0xcd2f56ea038c3c63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c6a expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.917538:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651963.917540:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651963.917542:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651963.917565:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147631744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651963.917855:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788651963.917999:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147631744 00000100:00100000:3.0:1788651963.918013:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147631744 00000100:00100000:3.0:1788651963.918059:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788651963.918066:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d2a30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3635:x1875537147631744:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788651963.918071:0:6497:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788651963 with bad export cookie 14785131664762484529 00010000:00010000:1.0:1788651963.918726:0:15400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.921678:0:15400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.921692:0:15400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.921701:0:15400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.921891:0:15400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651963.921902:0:15400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.921941:0:15400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.921962:0:15400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.921968:0:15400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.921999:0:15400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788651963.922006:0:15400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922013:0:15400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922018:0:15400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922023:0:15400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922034:0:15400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788651963.922042:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788651963.922048:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922054:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651963.922058:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922066:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651963.922080:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651963.922085:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788651963.922088:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1788651963.922223:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788651963.922229:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.922237:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651963.922240:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.922259:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651963.922266:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651963.922271:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788651963.922273:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788651963.922276:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788651963.922324:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922324:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922340:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651963.922342:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651963.922367:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.922375:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5000/0xcd2f56ea038c3b4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3b52 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.922393:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651963.922396:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.922402:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651963.922404:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.922411:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651963.922427:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651963.922433:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788651963.922436:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788651963.922437:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788651963.922451:0:6498:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.922457:0:6498:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788651963.922472:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.922479:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c0031c00/0xcd2f56ea038c3ed9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3ee0 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651963.922489:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651963.922490:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651963.922492:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651963.922498:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651963.922513:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147632000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651963.922576:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651963.922642:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147632128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651963.922665:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788651963.922683:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651963.922687:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788651963.922695:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1503600/0xcd2f56ea038c3c71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c3c78 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788651963.922697:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147631872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651963.922714:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651963.922717:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651963.922719:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651963.922733:0:15400:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9a00/0xcd2f56ea038c3834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922741:0:15400:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9a00/0xcd2f56ea038c3834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922747:0:15400:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9a00/0xcd2f56ea038c3834 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922753:0:15400:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f87021f9a00/0xcd2f56ea038c3834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.922837:0:15400:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788651963.922842:0:15400:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788651963.922846:0:15400:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788651963.922890:0:15400:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788651963.922893:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788651963.922898:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651963.922903:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788651963.922926:0:15400:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8f85c32ca000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788651963.922933:0:15400:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8f85c19f4800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788651963.922938:0:15400:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8f86ea1f3380) has exports, disconnecting them 00000020:00080000:0.0:1788651963.922942:0:15400:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f85c32ca000), last request at 1788651959 00000020:00000080:0.0:1788651963.922949:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3b13 00000100:00080000:0.0:1788651963.922968:0:15400:0:(import.c:65:import_set_state_nolock()) ffff8f85c32cc000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788651963.923016:0:15400:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c32ca000): rc 0 00000020:00000080:0.0:1788651963.923018:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f85c32ca000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788651963.923030:0:15400:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8f85c19f4800), last request at 1788651959 00000020:00000080:0.0:1788651963.923033:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c39ed 00000100:00080000:0.0:1788651963.923038:0:15400:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f7800 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788651963.923051:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32ca000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:0.0:1788651963.924167:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c32cc000 for lustre-MDT0001 00010000:00010000:0.0:1788651963.924188:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651963.924194:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9a00/0xcd2f56ea038c3834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.924202:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9a00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651963.924206:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9a00/0xcd2f56ea038c3834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.924302:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9a00/0xcd2f56ea038c3834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651963.924309:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9a00/0xcd2f56ea038c3834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651963.924314:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788651963.924317:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788651963.924320:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788651963.924505:0:7452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9a00/0xcd2f56ea038c3834 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.924511:0:7452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788651963.924539:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9a00/0xcd2f56ea038c3834 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.924545:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9a00/0xcd2f56ea038c3834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xcd2f56ea038c383b expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651963.924562:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651963.924564:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651963.924566:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788651963.924588:0:15400:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c19f4800): rc 0 00000020:00000080:0.0:1788651963.924591:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f85c19f4800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788651963.924606:0:15400:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa71c01cd7ae0 00000100:00100000:1.0:1788651963.925037:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651963.925122:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147632000 00000100:00100000:1.0:1788651963.925139:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147632000 00000020:00000080:0.0:1788651963.925155:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c19f4800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:1.0:1788651963.925171:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147632128 00000100:00100000:1.0:1788651963.925176:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147632128 00000100:00100000:1.0:1788651963.925191:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147631872 00000100:00100000:1.0:1788651963.925193:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147631872 00000020:00000080:0.0:1788651963.925199:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c19f7800 for lustre-MDT0001 00000100:00100000:1.0:1788651963.925211:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788651963.925222:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3636:x1875537147632000:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788651963.925230:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788651963 with bad export cookie 14785131664762484529 00000100:00100000:1.0:1788651963.925286:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3636:x1875537147632000:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (2710us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788651963.925293:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788651963.925310:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788651963.925315:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1875537147632128:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788651963.925319:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788651963 with bad export cookie 14785131664762484529 00000100:00100000:1.0:1788651963.925349:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1875537147632128:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (2682us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788651963.925355:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788651963.925367:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788651963.925370:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1875537147631872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788651963.925374:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788651963 with bad export cookie 14785131664762484529 00000100:00100000:1.0:1788651963.925398:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3637:x1875537147631872:12345-0@lo:103:ldlm_bl.0 Request processed in 26us (2670us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788651963.925404:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788651963.925419:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651963.925434:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147632256:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651963.925469:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788651963.925495:0:6495:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147632256 00000100:00100000:1.0:1788651963.925504:0:6495:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147632256 00000100:00100000:1.0:1788651963.925520:0:6495:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788651963.925525:0:6495:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875537147632256:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788651963.925529:0:6495:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788651963 with bad export cookie 14785131664762484529 00000100:00100000:1.0:1788651963.925559:0:6495:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3635:x1875537147632256:12345-0@lo:103:ldlm_bl.0 Request processed in 32us (88us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788651963.925565:0:6495:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1788651963.925592:0:3635:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.145@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788651963.925596:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8f86c92df000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1788651963.925600:0:3635:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.145@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788651963.925699:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788651963.925709:0:15400:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8f86ff461f80 x1875537147629824/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788651974 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788651963.925728:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1788651963.928970:0:15400:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788651963.928981:0:15400:0:(import.c:65:import_set_state_nolock()) ffff8f86f095e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788651963.934827:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788651963.934834:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1788651963.934859:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788651963.934946:0:15400:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788651963.934976:0:15400:0:(import.c:65:import_set_state_nolock()) ffff8f85c1a54800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788651963.934997:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788651963.935000:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1788651963.935011:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788651963.935074:0:15400:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788651963.935083:0:15400:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f6800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788651963.935105:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8f86ea1f3380) has no exports 00000100:00080000:0.0:1788651963.939473:0:3636:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.145@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788651963.943728:0:3635:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.145@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1788651963.943734:0:3635:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788651963.943745:0:3635:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d1180 x1875537147630208/t0(0) o400->MGC192.168.204.145@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788651975 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651963.943760:0:3635:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d1f80 x1875537147631744/t0(0) o103->MGC192.168.204.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788651979 ref 1 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651963.943770:0:3635:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f85c345b480 x1875537147632000/t0(0) o103->MGC192.168.204.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788651979 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651963.951975:0:3635:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f85c345a300 x1875537147632128/t0(0) o103->MGC192.168.204.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788651979 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651963.951986:0:3635:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d0380 x1875537147631872/t0(0) o103->MGC192.168.204.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788651979 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788651963.951994:0:3635:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d0e00 x1875537147632256/t0(0) o103->MGC192.168.204.145@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788651979 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788651963.952004:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788651963.952008:0:3635:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788651963.952010:0:3635:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788651963.954022:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d2a30050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3635:x1875537147631744:12345-0@lo:103:ldlm_bl.0 Request processed in 35946us (36158us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788651963.954035:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788651963.955184:0:3636:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8f86c92df000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788651963.955208:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3636:1875537147632000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788651963.955258:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651963.955279:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147631872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651963.955288:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3637:1875537147632128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788651963.957613:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147629824:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788651963.957825:0:3635:0:(import.c:65:import_set_state_nolock()) ffff8f86c92df000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788651963.957850:0:3635:0:(import.c:545:import_select_connection()) MGC192.168.204.145@tcp: connect to NID 0@lo last attempt 145 00000100:00080000:1.0:1788651963.957859:0:3635:0:(import.c:665:import_select_connection()) MGC192.168.204.145@tcp: import ffff8f86c92df000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788651963.957878:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147632384:0@lo:9:umount.0 00000100:00100000:1.0:1788651963.957999:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651963.958023:0:3635:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d0380 x1875537147632640/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788651963.958040:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147632512:0@lo:9:umount.0 00000100:00100000:0.0:1788651963.958056:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147631744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788651963.958069:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788651963.958075:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147630208:0@lo:400:kworker.0 00000100:00100000:1.0:1788651963.958099:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3634:1875537147632640:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:1.0:1788651963.958117:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875537147632640 offset 0 length 520: 4 00000100:00100000:3.0:1788651963.958183:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147632384 00000100:00100000:3.0:1788651963.958192:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147632384 00000100:00080000:1.0:1788651963.958315:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788651963.958328:0:8744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147632512 00000100:00100000:3.0:1788651963.958332:0:8744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147632512 00000100:00100000:2.0:1788651963.958357:0:8427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788651963.958373:0:8427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3634:x1875537147632384:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788651963.958400:0:8427:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3a3a 00000100:00080000:2.0:1788651963.958409:0:8427:0:(import.c:65:import_set_state_nolock()) ffff8f85c1a55800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788651963.958455:0:8427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788651963.958468:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3635:1875537147632256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788651963.958545:0:8744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788651963.958554:0:8744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3634:x1875537147632512:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788651963.958572:0:8744:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3b7c 00000100:00080000:3.0:1788651963.958579:0:8744:0:(import.c:65:import_set_state_nolock()) ffff8f85c354f800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788651963.958605:0:8427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3634:x1875537147632384:12345-0@lo:9:umount.0 Request processed in 238us (606us total) trans 0 rc 0/0 00000001:00000004:3.0:1788651963.958612:0:8744:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:2.0:1788651963.958614:0:8427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00010000:2.0:1788651963.958637:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788651963.958673:0:6506:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788651963.958699:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c1a54800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788651963.958720:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788651963.958722:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788651963.958726:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147632384:0@lo:9:umount.0 00000100:00100000:3.0:1788651963.959691:0:8744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3634:x1875537147632512:12345-0@lo:9:umount.0 Request processed in 1136us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788651963.959700:0:8744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00010000:3.0:1788651963.959721:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788651963.960991:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f6800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788651963.961019:0:3634:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788651963.961022:0:3634:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788651963.961027:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147632512:0@lo:9:umount.0 00000020:00080000:3.0:1788651963.976440:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8f86ea1f3380) has no exports 00000020:01000000:0.0:1788651964.039982:0:15400:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86ee8c12a0 - data ffff8f86f87070d8/ffff8f86ea1c8400 00000020:01000000:0.0:1788651964.040151:0:15400:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86ee8c1360 - data ffff8f86f860f510/ffff8f86ee8cc400 00000001:00000004:0.0:1788651964.051732:0:15400:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:2.0:1788651964.143503:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788651964.143513:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1788651964.143521:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788651964.146134:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788651964.146162:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:2.0:1788651964.146181:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788651964.146184:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788651964.149642:0:8735:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788651964.149650:0:8735:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:1.0:1788651964.149675:0:8735:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788651964.153748:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788651964.153757:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:1.0:1788651964.153791:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788651964.153794:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788651964.155279:0:9833:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788651964.155285:0:9833:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788651964.155299:0:9833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1788651964.159442:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3857 00000020:00000080:1.0:1788651964.159456:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86ea1e1800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788651964.161998:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea1e1800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788651964.163432:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c386c 00000020:00000080:1.0:1788651964.163460:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86edd6a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788651964.163479:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788651964.163484:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651964.163492:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788651964.163496:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8f86ea1f4d40) has no exports 00000020:00000080:2.0:1788651964.163681:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd6a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000004:01000000:1.0:1788651964.164237:0:15400:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788651964.164247:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3b75 00000020:00000080:1.0:1788651964.164253:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f85c2ad9800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788651964.164263:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788651964.164268:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651964.164276:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788651964.164280:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff8f85c2934d40) has no exports 00000020:00000080:1.0:1788651964.164285:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3b6e 00000020:00000080:1.0:1788651964.164289:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f85c210b000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788651964.164427:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2ad9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788651964.164436:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c210b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788651964.165598:0:15400:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788651964.165605:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788651964.165609:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1788651964.166202:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788651964.166206:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788651964.166288:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651964.166301:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788651964.166311:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3a33 00000020:00000080:1.0:1788651964.166319:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86edd6b000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788651964.166324:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788651964.166329:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651964.166334:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00000080:2.0:1788651964.166454:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c19f6800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1788651964.166463:0:36:0:(genops.c:885:class_export_put()) final put ffff8f85c32cb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788651964.166465:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32cb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1788651964.166473:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788651964.166554:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd6b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00080000:1.0:1788651964.166683:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8f86fb24b380) has no exports 00000020:00000080:1.0:1788651964.166692:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3a2c 00000020:00000080:1.0:1788651964.166696:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f85c1a53000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788651964.166742:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c1a53000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788651964.168432:0:15400:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788651964.168441:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788651964.168445:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1788651964.168466:0:15400:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788651964.168468:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788651964.168524:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651964.168534:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788651964.168552:0:15400:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788651964.168559:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c388f 00000020:00000080:1.0:1788651964.168567:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86f5772000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788651964.168572:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788651964.168577:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651964.168581:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788651964.168585:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8f86f560b380) has no exports 00000020:00000080:1.0:1788651964.168590:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3888 00000020:00000080:1.0:1788651964.168593:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86f0959800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788651964.169045:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c1a54800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1788651964.169054:0:36:0:(genops.c:885:class_export_put()) final put ffff8f85c1a55000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788651964.169056:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c1a55000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1788651964.169065:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788651964.169155:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f5772000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788651964.169161:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f0959800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788651964.171970:0:15400:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788651964.171979:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788651964.171988:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788651964.172001:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788651964.172050:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651964.172062:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788651964.172161:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651964.172166:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788651964.172171:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86f49dc800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788651964.172175:0:15400:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f49dc800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788651964.172182:0:15400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788651964.172318:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86f095e000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1788651964.172327:0:36:0:(genops.c:885:class_export_put()) final put ffff8f86f095f800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788651964.172330:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f095f800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1788651964.172337:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788651964.172520:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3873 00000020:00000080:0.0:1788651964.172528:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86edd68000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788651964.172541:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788651964.172558:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651964.172564:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788651964.172569:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8f86ea1f0000) has no exports 00000020:00000080:0.0:1788651964.172591:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651964.172594:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788651964.172598:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c387a 00000020:00000080:0.0:1788651964.172765:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86edd6e000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1788651964.172805:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd68000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000004:0.0:1788651964.172807:0:15400:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86f48d9800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788651964.172811:0:36:0:(genops.c:885:class_export_put()) final put ffff8f86edd68800/lustre-MDD0001_UUID 00000020:01000004:0.0:1788651964.172812:0:15400:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86f48d9800 2 00000020:00000080:2.0:1788651964.172816:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd68800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000004:0.0:1788651964.172818:0:15400:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f86f48d9800 from lustre-MDT0001 00000020:01000000:2.0:1788651964.172824:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788651964.172841:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651964.172846:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788651964.172849:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86ea1e7000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788651964.172852:0:15400:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ea1e7000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788651964.172860:0:15400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788651964.172927:0:15400:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788651964.172931:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788651964.172934:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651964.172938:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788651964.172946:0:15400:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8f86ee84b800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788651964.172951:0:15400:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8f86f5608000) has exports, disconnecting them 00000020:00080000:0.0:1788651964.172957:0:15400:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8f86ee84b800), last request at 1788651712 00000020:00000080:0.0:1788651964.172961:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c38ce 00000020:00080000:0.0:1788651964.172974:0:15400:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f86ee84b800): rc 0 00000020:00000080:0.0:1788651964.172978:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86ee84b800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788651964.173049:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86edd6e000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788651964.173056:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ee84b800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:2.0:1788651964.195049:0:15400:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:2.0:1788651964.195057:0:15400:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788651964.195062:0:15400:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788651964.195071:0:15400:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788651964.195104:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86ee84e800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:2.0:1788651964.195290:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788651964.195298:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:2.0:1788651964.195304:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86d0999800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:2.0:1788651964.195307:0:15400:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86d0999800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:2.0:1788651964.195316:0:15400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:2.0:1788651964.195384:0:15400:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86f48d9800 1 00000020:00000080:2.0:1788651964.195389:0:15400:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c380a 00000020:00000080:2.0:1788651964.195395:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86f4b0a800/lustre-MDT0001-osd_UUID 00000020:01000000:2.0:1788651964.195408:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:2.0:1788651964.195415:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f4b0a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788651964.195422:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788651964.195426:0:15400:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788651964.195429:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8f86c8db3380) has no exports 00000020:00000080:0.0:1788651964.355380:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651964.355396:0:15400:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788651964.355403:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86f48de800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788651964.355408:0:15400:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86f48de800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788651964.355420:0:15400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788651964.355554:0:15400:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f86f48db800 00000020:01000000:0.0:1788651964.355577:0:15400:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788651964.355581:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651964.355584:0:15400:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788651964.355589:0:15400:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8f86da6c0000) has no exports 00000100:00100000:0.0:1788651964.355717:0:6510:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8f86c3805c00:6510] 1 exiting: rc = 0 00000100:00100000:0.0:1788651964.355834:0:6509:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8f86c2bbce00:6509] 0 exiting: rc = 1 00000100:00100000:2.0:1788651964.358144:0:10110:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8f85c3135200:10110] 3 exiting: rc = 0 00000100:00100000:2.0:1788651964.358728:0:6511:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8f86c3804000:6511] 2 exiting: rc = 0 00000100:00100000:2.0:1788651964.359405:0:12192:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8f85c2ab6c00:12192] 4 exiting: rc = 0 00000100:00100000:0.0:1788651964.359864:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.359873:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360550:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360562:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360568:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360574:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360580:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360586:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360593:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360599:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360605:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360611:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360617:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360622:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360627:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360633:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360638:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360643:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360655:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360660:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360667:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360678:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360684:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360692:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360698:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360712:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360719:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360725:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360731:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360737:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360748:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360755:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360762:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360768:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360796:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.360819:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363765:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363813:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363819:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363825:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363830:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363836:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363851:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363857:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363868:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363873:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363896:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363902:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363983:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.363998:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364004:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364016:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364022:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364027:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364032:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364037:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364043:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364370:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364376:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364383:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364394:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364399:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364404:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.364409:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788651964.371728:0:6512:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8f86d14f4c00:6512] 0 exiting: rc = 1 00000100:00100000:1.0:1788651964.371866:0:6513:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8f86d14f4400:6513] 1 exiting: rc = 0 00000100:00100000:0.0:1788651964.372555:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372564:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372570:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372576:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372581:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372587:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372612:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372621:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372626:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372632:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372639:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372646:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372652:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372657:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372662:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372668:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372673:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372679:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372684:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372689:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372694:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372699:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372703:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372708:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372712:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372717:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372722:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372727:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372732:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372738:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372743:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372748:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372753:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372758:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372763:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372767:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372784:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372788:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372794:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372800:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372804:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372816:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372821:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372827:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372832:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372837:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372842:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372848:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372854:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372859:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372865:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372869:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.372873:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.373850:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.373865:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.373871:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.373876:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.374267:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.374273:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.374278:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.374283:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.374289:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.374400:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.374408:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.375399:0:7820:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8f86ee933600:7820] 2 exiting: rc = 0 00000100:00100000:2.0:1788651964.375609:0:6514:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8f86d289e800:6514] 0 exiting: rc = 1 00000100:00100000:3.0:1788651964.375803:0:6515:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8f86d0d8e000:6515] 1 exiting: rc = 0 00000100:00100000:0.0:1788651964.375904:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.375941:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.375950:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.375969:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.375976:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.375982:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.375988:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.375994:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376001:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376007:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376014:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376036:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376042:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376176:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376241:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376263:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376271:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376277:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376283:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376289:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376346:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376353:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376359:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376364:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376370:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376375:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376381:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376401:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376409:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376415:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376421:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376428:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376438:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376444:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376449:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376455:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376461:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376533:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376540:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376560:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376567:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376573:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376579:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376585:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376591:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376596:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376610:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376615:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376622:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376627:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376633:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376654:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376661:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376667:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376672:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376678:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376684:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376689:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376695:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376701:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376707:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376713:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376719:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.376725:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390115:0:6517:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8f86fb1c4800:6517] 1 exiting: rc = 0 00000100:00100000:3.0:1788651964.390408:0:6516:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8f86fb1c5800:6516] 0 exiting: rc = 1 00000100:00100000:1.0:1788651964.390676:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390685:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390690:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390697:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390703:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390708:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390713:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390718:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390724:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390729:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390734:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390739:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390743:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390748:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390754:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390759:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390765:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390779:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390785:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390802:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390807:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390813:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390819:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390824:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390829:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390834:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390839:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390844:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390849:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390853:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390859:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390864:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390870:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390885:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390892:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390896:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390901:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390968:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390975:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390980:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390985:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390990:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.390995:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391000:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391004:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391008:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391013:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391018:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391022:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391027:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391031:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391036:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391040:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391104:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391117:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391122:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391127:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391133:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391138:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391143:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391148:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391154:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391160:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.391165:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651964.392089:0:6519:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8f86fb1c4e00:6519] 1 exiting: rc = 0 00000100:00100000:3.0:1788651964.392432:0:6518:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8f86fb1c4200:6518] 0 exiting: rc = 1 00000100:00100000:1.0:1788651964.392822:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392830:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392836:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392841:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392845:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392850:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392856:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392860:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392865:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392869:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392875:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392890:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392895:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392900:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392905:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392947:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392952:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392957:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392962:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392967:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392971:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392977:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392981:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392987:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.392991:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393009:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393014:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393019:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393024:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393029:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393033:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393038:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393304:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393313:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393319:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393324:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393330:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393335:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393340:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393345:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393351:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393356:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393361:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393365:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393370:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393374:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393380:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393385:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393390:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393394:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393399:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393404:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393410:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393414:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393419:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393423:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393428:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393433:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393438:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393442:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393457:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393463:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393541:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.393547:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651964.394366:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8f86c92c7400:6521] 1 exiting: rc = 0 00000100:00100000:1.0:1788651964.394660:0:6520:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8f86c92c7600:6520] 0 exiting: rc = 1 00000100:00100000:0.0:1788651964.394782:0:14065:0:(service.c:3183:ptlrpc_main()) mdt_fld_0002: service thread [ffff8f85c3465800:14065] 2 exiting: rc = 0 00000100:00100000:1.0:1788651964.395524:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395532:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395537:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395542:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395547:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395553:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395558:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395563:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395568:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395572:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395578:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395583:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395588:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395592:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395597:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395603:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395608:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395614:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395619:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395624:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395629:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395635:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395640:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395645:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395650:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395655:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395659:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395664:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395668:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395673:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395691:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395695:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395700:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395704:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395709:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395713:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395718:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395723:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395728:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395733:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395738:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395743:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395749:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395754:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395759:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395765:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395781:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395786:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395792:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395797:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395801:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395805:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395810:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395815:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395819:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395824:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395829:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395834:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395839:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395844:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395849:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395855:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395860:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651964.395866:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.397690:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8f86fb1c0a00:6523] 1 exiting: rc = 0 00000100:00100000:0.0:1788651964.397938:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8f86fb1c5e00:6524] 2 exiting: rc = 0 00000100:00100000:3.0:1788651964.398594:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8f86fb1c5200:6522] 0 exiting: rc = 1 00000100:00100000:0.0:1788651964.398868:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398886:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398894:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398900:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398927:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398933:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398939:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398945:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398950:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398957:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398962:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398967:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398972:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398977:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.398995:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399001:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399006:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399011:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399016:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399021:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399028:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399033:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399040:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399067:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399074:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399079:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399084:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399089:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399095:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399100:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399107:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399113:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399118:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399124:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399129:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399135:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399141:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399146:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399153:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399159:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399164:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399169:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399175:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399180:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399197:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399203:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399208:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399227:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399235:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399247:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399253:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399258:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399263:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399268:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399273:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399279:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399284:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399289:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399295:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399303:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399312:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399317:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399322:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651964.399335:0:15400:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788651964.405539:0:15400:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651964.405555:0:15400:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788651964.405561:0:15400:0:(genops.c:885:class_export_put()) final put ffff8f86c92d8000/MDS_uuid 00000020:00000080:0.0:1788651964.405565:0:15400:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c92d8000/MDS_uuid for MDS 00000020:01000000:0.0:1788651964.405570:0:15400:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788651964.405722:0:15400:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788651964.897010:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788651964.899337:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788651964.899348:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788651964.899369:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788651964.899374:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788651964.899379:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c210e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788651964.899389:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1788651964.899396:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788651964.899403:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f85c210e800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788651964.899449:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff446a00 x1875537147632768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788651964.899518:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788651964.899522:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788651964.899524:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c3181800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788651964.899528:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 415 00000100:00080000:2.0:1788651964.899531:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788651964.899534:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f85c3181800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788651964.899547:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff447800 x1875537147633024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788651964.899659:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147632768:0@lo:38:kworker.0 00000400:00000100:1.0:1788651964.899716:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147632768 offset 0 length 520: 4 00000100:00100000:1.0:1788651964.899786:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147633024:0@lo:38:kworker.0 00000400:00000100:1.0:1788651964.899803:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147633024 offset 0 length 520: 4 00000100:00100000:0.0:1788651964.899893:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147632896:0@lo:400:kworker.0 00000400:00000100:0.0:1788651964.899953:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147632896 offset 0 length 224: 4 00000100:00100000:0.0:1788651964.899978:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147633152:0@lo:400:kworker.0 00000400:00000100:0.0:1788651964.899996:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147633152 offset 0 length 224: 4 00010000:00010000:2.0:1788651965.929268:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651966.944790:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651967.971074:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788651968.741048:0:15600:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788651968.764532:0:15600:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788651968.764592:0:15600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651968.764617:0:15600:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651968.764624:0:15600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651968.764650:0:15600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651968.764724:0:15600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788651968.764730:0:15600:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788651968.764815:0:15600:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788651968.764828:0:15600:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86ff446a00 x1875537147632768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788651979 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651968.764851:0:15600:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788651968.764856:0:15600:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788651968.764863:0:15600:0:(import.c:65:import_set_state_nolock()) ffff8f85c210e800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788651968.764868:0:15600:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788651968.764871:0:15600:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86ff446a00 x1875537147632768/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788651979 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651968.764878:0:15600:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788651968.764881:0:15600:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:1.0:1788651968.765204:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147632768:0@lo:38:kworker.0 00000100:00080000:2.0:1788651968.766527:0:15600:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788651968.766543:0:15600:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86ff445f80 x1875537147632896/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651980 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651968.767190:0:15600:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788651968.767200:0:15600:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788651968.767228:0:15600:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f4000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788651968.767472:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875537147633280:0@lo:39:umount.0 00000400:00000100:3.0:1788651968.767527:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147633280 offset 0 length 224: 4 00010000:00010000:0.0:1788651968.769090:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651968.769103:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651968.769114:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503a00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651968.769118:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651968.769147:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651968.769154:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651968.769159:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788651968.769162:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788651968.769166:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788651968.769187:0:7452:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f86c92df000 00010000:00010000:0.0:1788651968.769190:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651968.769197:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1503a00/0xcd2f56ea038c3c47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3c4e expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651968.769212:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651968.769213:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651968.769215:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788651968.769293:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147632896:0@lo:400:kworker.0 00000100:00080000:0.0:1788651968.928261:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788651968.928272:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788651968.928275:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788651968.928290:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788651968.928420:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788651968.928441:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147633408:0@lo:400:kworker.0 00000400:00000100:2.0:1788651968.928507:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147633408 offset 0 length 224: 4 00010000:00010000:1.0:1788651968.993817:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788651969.952383:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788651969.952393:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788651969.952396:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788651969.952421:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788651969.952625:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147633536:0@lo:400:kworker.0 00000400:00000100:3.0:1788651969.952711:0:3635:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147633536 offset 0 length 224: 4 00010000:00010000:3.0:1788651970.016898:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788651970.022398:0:9506:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788651970.022408:0:9506:0:(genops.c:885:class_export_put()) final put ffff8f85c354b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788651970.023478:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c354b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788651970.023575:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c354f800 for lustre-OST0001 00000001:00100000:0.0:1788651970.028282:0:8422:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788651970.028292:0:8422:0:(genops.c:885:class_export_put()) final put ffff8f85c1a51000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788651970.028649:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c1a51000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788651970.028758:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c1a55800 for lustre-OST0000 00010000:00010000:0.0:1788651971.040073:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651972.064550:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651973.088256:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651973.920359:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788651963/real 1788651963] req@ffff8f86f48d0380 x1875537147632640/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788651973 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651973.920398:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86f48d0380 x1875537147632640/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788651973 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788651973.920419:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c92df000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788651973.920442:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788651973.920445:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3634:1875537147632640:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:2.0:1788651973.921551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788651973.921561:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788651973.921564:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f86c92df000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788651973.921572:0:36:0:(import.c:545:import_select_connection()) MGC192.168.204.145@tcp: connect to NID 0@lo last attempt 419 00000100:00080000:2.0:1788651973.921578:0:36:0:(import.c:630:import_select_connection()) MGC192.168.204.145@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788651973.921584:0:36:0:(import.c:665:import_select_connection()) MGC192.168.204.145@tcp: import ffff8f86c92df000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788651973.921663:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff447480 x1875537147633664/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788651973.921693:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788651973.921698:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788651973.921783:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147633792:0@lo:400:kworker.0 00000400:00000100:1.0:1788651973.921838:0:3636:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147633792 offset 0 length 224: 4 00000100:00100000:3.0:1788651973.922524:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3634:1875537147633664:0@lo:250:kworker.0 00000400:00000100:3.0:1788651973.922555:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875537147633664 offset 0 length 520: 4 00010000:00010000:0.0:1788651974.112030:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651975.136550:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651976.164753:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651977.187071:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788651978.016041:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788651968/real 1788651968] req@ffff8f86ff444a80 x1875537147633280/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788651978 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651978.016076:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86ff444a80 x1875537147633280/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788651978 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788651978.016099:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f4000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788651978.016116:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875537147633280:0@lo:39:umount.0 00000100:00080000:2.0:1788651978.016266:0:15600:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788651978.016271:0:15600:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788651978.016276:0:15600:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788651978.018439:0:15600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651978.018460:0:15600:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651978.018466:0:15600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651978.018473:0:15600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651978.018565:0:15600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788651978.018574:0:15600:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651978.018581:0:15600:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651978.018587:0:15600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651978.018594:0:15600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788651978.018608:0:15600:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788651978.018613:0:15600:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788651978.018639:0:15600:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788651978.018644:0:15600:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788651978.018649:0:15600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788651978.018655:0:15600:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788651978.018660:0:15600:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8f86fb24cd40) has no exports 00000020:00080000:2.0:1788651978.018686:0:15600:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8f86fb24cd40) has no exports 00010000:00010000:3.0:1788651978.019136:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788651978.019145:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651978.019167:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651978.019170:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651978.019179:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651978.019185:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651978.019202:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651978.019205:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788651978.019208:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788651978.019223:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f86c92df000 00010000:00010000:3.0:1788651978.019227:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651978.019234:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1502400/0xcd2f56ea038c3c55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3c5c expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651978.019249:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788651978.019253:0:6499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651978.019258:0:6499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788651978.019261:0:6499:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651978.019267:0:6499:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651978.019280:0:6499:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651978.019285:0:6499:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788651978.019287:0:6499:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788651978.019289:0:6499:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788651978.019295:0:6499:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f86c92df000 00010000:00010000:3.0:1788651978.019298:0:6499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651978.019304:0:6499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4800/0xcd2f56ea038c3ecb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3ed2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651978.019312:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651978.019314:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651978.019316:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651978.019460:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788651978.028896:0:15600:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86d10f91e0 - data ffff8f86f860d510/ffff8f86ff48e000 00000020:01000000:3.0:1788651978.029055:0:15600:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f85c205c7e0 - data ffff8f86f865ee58/ffff8f86f4adb400 00100000:10000000:3.0:1788651978.037287:0:15600:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788651978.047432:0:15600:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c39a7 00000020:00000080:0.0:1788651978.047446:0:15600:0:(genops.c:885:class_export_put()) final put ffff8f85c1a57000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788651978.047472:0:15600:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86eeab9800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788651978.047476:0:15600:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86eeab9800 2 00000020:01000004:0.0:1788651978.047480:0:15600:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f86eeab9800 from lustre-OST0000 00000020:00000080:0.0:1788651978.047515:0:15600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651978.047527:0:15600:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788651978.047531:0:15600:0:(genops.c:885:class_export_put()) final put ffff8f85c196f000/lustre-OST0000_UUID 00000020:00000080:0.0:1788651978.047533:0:15600:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c196f000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788651978.047540:0:15600:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788651978.047626:0:15600:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788651978.047631:0:15600:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788651978.047635:0:15600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651978.047641:0:15600:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788651978.047648:0:15600:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8f85c2109000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788651978.047654:0:15600:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8f85c20f8000) has exports, disconnecting them 00000020:00080000:0.0:1788651978.047659:0:15600:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8f85c2109000), last request at 1788651734 00000020:00000080:0.0:1788651978.047663:0:15600:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c39d1 00000020:00080000:0.0:1788651978.047673:0:15600:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c2109000): rc 0 00000020:00000080:0.0:1788651978.047679:0:15600:0:(genops.c:885:class_export_put()) final put ffff8f85c2109000/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788651978.048211:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c1a57000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788651978.048229:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2109000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788651978.051448:0:15600:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788651978.051457:0:15600:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788651978.051461:0:15600:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788651978.051468:0:15600:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788651978.051539:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c210e800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788651978.051715:0:15600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651978.051726:0:15600:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788651978.051734:0:15600:0:(genops.c:885:class_export_put()) final put ffff8f86c8bb3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788651978.051738:0:15600:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c8bb3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788651978.051746:0:15600:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:1.0:1788651978.051825:0:15600:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788651978.051829:0:15600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651978.051834:0:15600:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788651978.051843:0:15600:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8f85c19f3000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788651978.051860:0:15600:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff8f86fcd73380) has exports, disconnecting them 00000020:00080000:1.0:1788651978.051864:0:15600:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8f85c19f3000), last request at 1788651734 00000020:00000080:1.0:1788651978.051868:0:15600:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c39e6 00000020:00080000:1.0:1788651978.051887:0:15600:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c19f3000): rc 0 00000020:00000080:1.0:1788651978.051892:0:15600:0:(genops.c:885:class_export_put()) final put ffff8f85c19f3000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788651978.051966:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c19f3000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788651978.058087:0:15600:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788651978.058098:0:15600:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788651978.058102:0:15600:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788651978.058110:0:15600:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788651978.058154:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c19f4000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788651978.058354:0:15600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788651978.058362:0:15600:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788651978.058368:0:15600:0:(genops.c:885:class_export_put()) final put ffff8f85c19f5800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788651978.058372:0:15600:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c19f5800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788651978.058378:0:15600:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788651978.058447:0:15600:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86eeab9800 1 00000020:00000080:2.0:1788651978.058455:0:15600:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c396f 00000020:00000080:2.0:1788651978.058462:0:15600:0:(genops.c:885:class_export_put()) final put ffff8f86ee967800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788651978.058471:0:15600:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788651978.058480:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ee967800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788651978.058489:0:15600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788651978.058494:0:15600:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788651978.058498:0:15600:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8f86f56099c0) has no exports 00010000:00010000:0.0:1788651978.278552:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788651978.295702:0:15600:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651978.295717:0:15600:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788651978.295723:0:15600:0:(genops.c:885:class_export_put()) final put ffff8f86eeabe000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788651978.295728:0:15600:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86eeabe000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788651978.295741:0:15600:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788651978.295870:0:15600:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f86eeab8800 00000020:02000400:0.0:1788651978.296584:0:15600:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00100000:3.0:1788651979.043600:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788651964/real 1788651964] req@ffff8f86ff447800 x1875537147633024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788651979 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651979.043629:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86ff447800 x1875537147633024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788651979 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788651979.043648:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3181800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788651979.043680:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788651979.043685:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147633024:0@lo:38:kworker.0 00000100:00080000:0.0:1788651979.044104:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788651979.044109:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788651979.044112:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788651979.044115:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788651979.044118:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c3181800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788651979.044123:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 420 00000100:00080000:0.0:1788651979.044128:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788651979.044134:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f85c3181800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788651979.044173:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d1880 x1875537147633920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788651979.044233:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147634048:0@lo:400:kworker.0 00000400:00000100:0.0:1788651979.044287:0:3637:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147634048 offset 0 length 224: 4 00000100:00100000:3.0:1788651979.047352:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147633920:0@lo:38:kworker.0 00000400:00000100:3.0:1788651979.047472:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147633920 offset 0 length 520: 4 00010000:00010000:3.0:1788651979.297208:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788651980.070152:0:3637:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788651964/real 1788651964] req@ffff8f86ff444e00 x1875537147633152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788651980 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788651980.101993:0:3637:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8f86ff444e00 x1875537147633152/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788651980 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788651980.102012:0:3637:0:(import.c:65:import_set_state_nolock()) ffff8f85c32ce000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788651980.102017:0:3637:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788651980.113663:0:3637:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1788651980.114215:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147633152:0@lo:400:kworker.0 00000100:00080000:0.0:1788651980.118385:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788651980.118395:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788651980.118398:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788651980.118401:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788651980.118404:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788651980.118421:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788651980.118425:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c32ce000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788651980.118436:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 214 00000100:00080000:0.0:1788651980.118449:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f85c32ce000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788651980.118506:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d3100 x1875537147634176/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788651980.118616:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875537147634176:0@lo:38:kworker.0 00000400:00000100:1.0:1788651980.118680:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875537147634176 offset 0 length 520: 4 00010000:00010000:0.0:1788651980.321078:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651981.346440:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651982.368123:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788651982.389656:0:15802:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788651982.396282:0:15802:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788651982.396368:0:15802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651982.396383:0:15802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651982.396389:0:15802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651982.396396:0:15802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651982.396416:0:15802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788651982.396430:0:15802:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788651982.396457:0:15802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788651982.396469:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d1880 x1875537147633920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788651999 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.396491:0:15802:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788651982.396496:0:15802:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788651982.396502:0:15802:0:(import.c:65:import_set_state_nolock()) ffff8f85c3181800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788651982.396506:0:15802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788651982.396510:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d1880 x1875537147633920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788651999 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.396537:0:15802:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788651982.396540:0:15802:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 22s for inflight to error out 00010000:00010000:0.0:1788651982.396690:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651982.396699:0:6498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651982.396706:0:6498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788651982.396710:0:6498:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651982.396718:0:6498:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788651982.396725:0:6498:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788651982.396731:0:6498:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788651982.396734:0:6498:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788651982.396746:0:6498:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788651982.396763:0:6498:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f86c92df000 00010000:00010000:0.0:1788651982.396767:0:6498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651982.396784:0:6498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c3c2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3c32 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651982.396795:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651982.396796:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788651982.396798:0:6498:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788651982.396840:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147633920:0@lo:38:kworker.0 00000100:00080000:3.0:1788651982.406812:0:15802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788651982.406828:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d1c00 x1875537147633408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651984 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.406848:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d2d80 x1875537147633536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651985 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.406861:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86ff444700 x1875537147633792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651989 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.406883:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d1500 x1875537147634048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651995 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.406891:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d3100 x1875537147634176/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788651990 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.406902:0:15802:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788651982.406932:0:15802:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788651982.406938:0:15802:0:(import.c:65:import_set_state_nolock()) ffff8f85c32ce000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1788651982.406943:0:15802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788651982.406947:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d1c00 x1875537147633408/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651984 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.406954:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d2d80 x1875537147633536/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651985 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.406962:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86ff444700 x1875537147633792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651989 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.406969:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d1500 x1875537147634048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788651995 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.406977:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86f48d3100 x1875537147634176/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788651990 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788651982.406997:0:15802:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788651982.407001:0:15802:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:1.0:1788651982.408855:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3635:1875537147633536:0@lo:400:kworker.0 00000100:00100000:1.0:1788651982.408958:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147633792:0@lo:400:kworker.0 00000100:00100000:0.0:1788651982.409517:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147634048:0@lo:400:kworker.0 00000100:00100000:0.0:1788651982.409586:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147633408:0@lo:400:kworker.0 00000100:00100000:1.0:1788651982.420814:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875537147634176:0@lo:38:kworker.0 00010000:00010000:0.0:1788651982.422783:0:15802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651982.422805:0:15802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651982.422813:0:15802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651982.422819:0:15802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651982.422853:0:15802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788651982.422862:0:15802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651982.422871:0:15802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651982.422890:0:15802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788651982.422897:0:15802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651982.422901:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788651982.423012:0:15802:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788651982.423018:0:15802:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788651982.423046:0:15802:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788651982.423051:0:15802:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788651982.423056:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651982.423075:0:15802:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788651982.423081:0:15802:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8f85c2ae0000) has no exports 00000020:00080000:0.0:1788651982.423115:0:15802:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff8f85c2ae0000) has no exports 00000020:01000000:0.0:1788651982.424790:0:15802:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f86c31175a0 - data ffff8f86f867b798/ffff8f85c3495000 00000020:01000000:0.0:1788651982.424973:0:15802:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8f85c339a0c0 - data ffff8f86f86ca0d8/ffff8f85c3528c00 00010000:00010000:1.0:1788651982.431112:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651982.431133:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503200 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651982.431138:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651982.431151:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651982.431160:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651982.431166:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788651982.431169:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788651982.431173:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788651982.431214:0:7452:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f86c92df000 00010000:00010000:1.0:1788651982.431219:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651982.431227:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1503200/0xcd2f56ea038c3c39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3c40 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651982.431246:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788651982.431251:0:7452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651982.431256:0:7452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788651982.431258:0:7452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651982.431264:0:7452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788651982.431270:0:7452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788651982.431275:0:7452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788651982.431277:0:7452:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788651982.431279:0:7452:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788651982.431284:0:7452:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f86c92df000 00010000:00010000:1.0:1788651982.431287:0:7452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651982.431293:0:7452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5e00/0xcd2f56ea038c3ebd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3ec4 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788651982.431317:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651982.431319:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788651982.431322:0:7452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788651982.431578:0:6499:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788651982.446221:0:15802:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788651982.458299:0:15802:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3acd 00000020:00000080:3.0:1788651982.458311:0:15802:0:(genops.c:885:class_export_put()) final put ffff8f85c2ade800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788651982.458362:0:15802:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f85c196d800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788651982.458365:0:15802:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f85c196d800 2 00000020:01000004:3.0:1788651982.458369:0:15802:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8f85c196d800 from lustre-OST0001 00000020:00000080:3.0:1788651982.458395:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788651982.458406:0:15802:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788651982.458409:0:15802:0:(genops.c:885:class_export_put()) final put ffff8f85c2adb000/lustre-OST0001_UUID 00000020:00000080:3.0:1788651982.458412:0:15802:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2adb000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788651982.458447:0:15802:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788651982.458635:0:15802:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1387a7f4-5194-4c3d-9855-aa6dad12ca23->MGS 00010000:00010000:3.0:1788651982.458650:0:15802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c3826 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c382d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651982.458662:0:15802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c3826 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c382d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651982.458668:0:15802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788651982.458670:0:15802:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788651982.458674:0:15802:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788651982.458693:0:15802:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f86c92df000 00010000:00010000:3.0:1788651982.458697:0:15802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86c1502800/0xcd2f56ea038c3826 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c382d expref: -99 pid: 7439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788651982.458711:0:15802:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xcd2f56ea038c3ca2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788651982.458732:0:15802:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xcd2f56ea038c3ca2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788651982.458746:0:15802:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788651982.458748:0:15802:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788651982.458750:0:15802:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788651982.460025:0:15802:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8f86c92df000 00010000:00010000:3.0:1788651982.460032:0:15802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4600/0xcd2f56ea038c3c9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xcd2f56ea038c3ca2 expref: -99 pid: 6507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788651982.460056:0:15802:0:(import.c:65:import_set_state_nolock()) ffff8f86c92df000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788651982.460060:0:15802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788651982.460062:0:15802:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788651982.460064:0:15802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788651982.460072:0:15802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788651982.460084:0:15802:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8f86ff447480 x1875537147633664/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788651988 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788651982.460162:0:15802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788651982.460165:0:15802:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1788651982.460220:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1387a7f4-5194-4c3d-9855-aa6dad12ca23:3634:1875537147633664:0@lo:250:kworker.0 10000000:01000000:3.0:1788651982.460322:0:15802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788651982.460332:0:15802:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3723 00000020:00000080:3.0:1788651982.460339:0:15802:0:(genops.c:885:class_export_put()) final put ffff8f86c92d9800/1387a7f4-5194-4c3d-9855-aa6dad12ca23 00000020:00000080:0.0:1788651982.461856:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c2ade800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788651982.462279:0:15802:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.145@tcp (flags='') 00000020:00000080:3.0:1788651982.462288:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788651982.462296:0:15802:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.145@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788651982.462300:0:15802:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8f86da6c3380) has no exports 00000020:00000080:0.0:1788651982.462382:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c92d9800/1387a7f4-5194-4c3d-9855-aa6dad12ca23 for MGC192.168.204.145@tcp 10000000:01000000:1.0:1788651982.463322:0:6507:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788651982.463415:0:15802:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.145@tcp: client import never connected 00000100:00080000:3.0:1788651982.463429:0:15802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788651982.463433:0:15802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788651982.463437:0:15802:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788651982.463454:0:15802:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788651982.463686:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788651982.463695:0:15802:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.145@tcp (uuid 1387a7f4-5194-4c3d-9855-aa6dad12ca23) 00000020:01000000:3.0:1788651982.463705:0:15802:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788651982.463708:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788651982.463712:0:15802:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788651982.463719:0:15802:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8f85c32cb800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788651982.463725:0:15802:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff8f85c20f99c0) has exports, disconnecting them 00000020:00080000:3.0:1788651982.463730:0:15802:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8f85c32cb800), last request at 1788651758 00000020:00000080:3.0:1788651982.463734:0:15802:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3af7 00000020:00080000:3.0:1788651982.463748:0:15802:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c32cb800): rc 0 00000020:00000080:3.0:1788651982.463753:0:15802:0:(genops.c:885:class_export_put()) final put ffff8f85c32cb800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788651982.463837:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f86c92df000 for MGC192.168.204.145@tcp 00000020:00000080:0.0:1788651982.463845:0:38:0:(genops.c:885:class_export_put()) final put ffff8f86c92da000/1387a7f4-5194-4c3d-9855-aa6dad12ca23 00000020:00000080:0.0:1788651982.463848:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86c92da000/1387a7f4-5194-4c3d-9855-aa6dad12ca23 for MGC192.168.204.145@tcp 00000020:01000000:0.0:1788651982.463854:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.145@tcp (1387a7f4-5194-4c3d-9855-aa6dad12ca23) 00000020:00000080:0.0:1788651982.465685:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32cb800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788651982.477983:0:15802:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788651982.477993:0:15802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788651982.477998:0:15802:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788651982.478006:0:15802:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788651982.478195:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788651982.478205:0:15802:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788651982.478212:0:15802:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788651982.478216:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788651982.478220:0:15802:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788651982.478241:0:15802:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8f85c32c8000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788651982.478248:0:15802:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff8f85c29319c0) has exports, disconnecting them 00000020:00080000:0.0:1788651982.478253:0:15802:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8f85c32c8000), last request at 1788651758 00000020:00000080:0.0:1788651982.478258:0:15802:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3b0c 00000020:00080000:0.0:1788651982.478278:0:15802:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8f85c32c8000): rc 0 00000020:00000080:0.0:1788651982.478282:0:15802:0:(genops.c:885:class_export_put()) final put ffff8f85c32c8000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788651982.479269:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c3181800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788651982.479280:0:38:0:(genops.c:885:class_export_put()) final put ffff8f85c210f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788651982.479283:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c210f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788651982.479296:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788651982.479364:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32c8000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788651982.479960:0:15802:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788651982.479965:0:15802:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788651982.479968:0:15802:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788651982.479973:0:15802:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788651982.479995:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8f85c32ce000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788651982.482073:0:6498:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788651982.482218:0:7452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788651982.483347:0:6499:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788651982.485564:0:9515:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8f86fcd8ba00:9515] 2 exiting: rc = 0 00000100:00100000:1.0:1788651982.488039:0:6493:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8f86d122e400:6493] 0 exiting: rc = 1 00000100:00100000:1.0:1788651982.491732:0:6494:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8f86d122e600:6494] 1 exiting: rc = 0 00000100:00100000:1.0:1788651982.491854:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.492177:0:6495:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8f86f0884c00:6495] 0 exiting: rc = 1 00000100:00100000:2.0:1788651982.494107:0:6496:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8f86f0885400:6496] 1 exiting: rc = 0 00000100:00100000:2.0:1788651982.494540:0:7919:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8f86f5767400:7919] 3 exiting: rc = 0 00000100:00100000:2.0:1788651982.494629:0:6497:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8f86f0885000:6497] 2 exiting: rc = 0 00000100:00100000:1.0:1788651982.494700:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494716:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494724:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494730:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494744:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494751:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494784:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494794:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494801:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494806:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494813:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494819:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494825:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494831:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494837:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494842:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494848:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494854:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494860:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.494991:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495003:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495009:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495017:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495023:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495028:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495036:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495041:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495046:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495055:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495059:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495065:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495073:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495079:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495096:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495250:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495261:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495266:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495271:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495276:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495282:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495287:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495300:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495306:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495312:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495317:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495322:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495327:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495332:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495338:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495343:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495347:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495352:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495357:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495362:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495367:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495373:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495378:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495383:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495388:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495393:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495398:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495404:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495410:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.495415:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788651982.502116:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651982.502132:0:15802:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788651982.502138:0:15802:0:(genops.c:885:class_export_put()) final put ffff8f85c32c9000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788651982.502144:0:15802:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c32c9000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788651982.502154:0:15802:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788651982.502227:0:15802:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f85c196d800 1 00000020:00000080:1.0:1788651982.502235:0:15802:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xcd2f56ea038c3a9c 00000020:00000080:1.0:1788651982.502242:0:15802:0:(genops.c:885:class_export_put()) final put ffff8f86eeb01800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788651982.502255:0:15802:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788651982.502264:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86eeb01800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788651982.502275:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651982.502293:0:15802:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788651982.502298:0:15802:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff8f86f560cd40) has no exports 00000020:00000080:1.0:1788651982.565410:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651982.565432:0:15802:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788651982.565439:0:15802:0:(genops.c:885:class_export_put()) final put ffff8f85c1969800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788651982.565443:0:15802:0:(genops.c:844:class_export_destroy()) destroying export ffff8f85c1969800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788651982.565450:0:15802:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788651982.565818:0:15802:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8f85c196e000 00000020:01000000:1.0:1788651982.565837:0:15802:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788651982.565841:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788651982.565844:0:15802:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788651982.565848:0:15802:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8f86fcd74d40) has no exports 00000020:00000080:1.0:1788651982.565871:0:15802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788651982.565876:0:15802:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788651982.565878:0:15802:0:(genops.c:885:class_export_put()) final put ffff8f86ee963800/OSS_uuid 00000020:00000080:1.0:1788651982.565881:0:15802:0:(genops.c:844:class_export_destroy()) destroying export ffff8f86ee963800/OSS_uuid for OSS 00000020:01000000:1.0:1788651982.565884:0:15802:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788651982.566104:0:8428:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8f86ee970000:8428] 1 exiting: rc = 0 00000100:00100000:3.0:1788651982.566200:0:8744:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8f85c1a38e00:8744] 3 exiting: rc = 0 00000100:00100000:3.0:1788651982.566278:0:8427:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8f86f5604200:8427] 0 exiting: rc = 1 00000100:00100000:2.0:1788651982.566489:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8f86ee971600:8429] 2 exiting: rc = 0 00000100:00100000:1.0:1788651982.566639:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566648:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566654:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566661:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566669:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566675:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566680:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566685:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566691:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566696:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566702:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566707:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566713:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566718:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566723:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566728:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566804:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566818:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566824:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566830:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566835:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566839:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566844:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566849:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566855:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566860:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566865:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566871:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566876:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566882:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566886:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566891:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566895:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566901:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566931:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566937:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566942:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566948:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566954:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566958:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566964:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566970:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566975:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566982:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566987:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566993:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.566998:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567004:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567009:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567015:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567023:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567029:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567043:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567048:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567054:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567059:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567065:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567070:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567077:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567082:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567087:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567092:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567097:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.567109:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:0.0:1788651982.568539:0:6506:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788651982.570726:0:13809:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8f85c2089200:13809] 2 exiting: rc = 0 00000100:00100000:0.0:1788651982.571538:0:8431:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8f86ee935e00:8431] 1 exiting: rc = 0 00000100:00100000:0.0:1788651982.573187:0:8430:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8f86f49cca00:8430] 0 exiting: rc = 1 00000100:00100000:2.0:1788651982.575063:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575080:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575087:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575093:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575098:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575103:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575109:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575114:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575119:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575124:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575129:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575135:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575141:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575152:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575163:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575168:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575173:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575179:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575185:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575190:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575195:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575200:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575205:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575209:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575213:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575217:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575223:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575306:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575312:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575317:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575322:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575327:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575333:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575348:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575368:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575374:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575379:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575384:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575389:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575394:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575400:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575406:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575412:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575426:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575432:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575437:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575442:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575447:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575452:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575458:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575464:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575469:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575474:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575478:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575483:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575488:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575495:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575501:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575506:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575511:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575516:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575522:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575527:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.575539:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.581569:0:8432:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8f86ee934200:8432] 0 exiting: rc = 1 00000100:00100000:0.0:1788651982.581763:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8f86ee935400:8433] 1 exiting: rc = 0 00000100:00100000:2.0:1788651982.581868:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8f86ee935200:8434] 2 exiting: rc = 0 00000100:00100000:2.0:1788651982.581949:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.581957:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.581963:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.581968:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.581985:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.581991:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.581996:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582001:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582007:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582012:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582018:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582023:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582029:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582042:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582049:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582054:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582059:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582064:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582069:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582074:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582079:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582085:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582091:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582096:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582101:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582107:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582112:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582118:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582124:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582130:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582136:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582142:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582148:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582154:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582160:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582167:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582173:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582194:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582203:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582216:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582222:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582240:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582247:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582253:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582259:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582267:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582273:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582281:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582288:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582294:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582299:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582305:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582310:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582316:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582323:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582339:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582346:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582351:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582357:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582363:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582368:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582374:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582380:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.582392:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.586762:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8f86ee935600:8435] 0 exiting: rc = 1 00000100:00100000:0.0:1788651982.586869:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8f86edc9de00:8436] 1 exiting: rc = 0 00000100:00100000:2.0:1788651982.587400:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587409:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587415:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587431:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587436:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587441:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587446:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587452:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587458:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587462:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587480:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587486:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587492:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587496:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587501:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587507:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587512:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587518:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587524:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587529:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587534:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587540:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587544:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587549:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587554:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587559:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587565:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587571:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587575:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587580:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587585:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587590:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587595:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587600:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587605:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587610:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587616:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587621:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587627:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587631:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587637:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587642:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587647:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587652:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587657:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587671:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587676:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587681:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587686:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587691:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587696:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587700:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587705:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587710:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587715:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587721:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587726:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587731:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587736:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587741:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587746:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587751:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587757:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788651982.587763:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788651982.592580:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8f86edc6e800:8437] 0 exiting: rc = 1 00000100:00100000:2.0:1788651982.592845:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8f86d2a2bc00:8438] 1 exiting: rc = 0 00000100:00100000:0.0:1788651982.594010:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594020:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594052:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594074:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594081:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594088:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594109:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594138:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594184:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594197:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594248:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594262:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594285:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594334:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594354:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594361:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594379:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594387:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594393:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594444:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594452:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594458:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594465:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594472:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594479:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594485:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594494:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594499:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594505:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594510:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594516:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594536:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594543:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594549:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594554:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594561:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594567:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594572:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594578:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594584:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594590:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594596:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594602:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594664:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594672:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594677:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594683:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594690:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594704:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594711:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594718:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594741:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594749:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594754:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594779:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594818:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594826:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594848:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594854:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594860:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594886:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594892:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.594899:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788651982.595010:0:15802:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788651982.607128:0:15802:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788652005.376636:0:16566:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788652016.923978:0:17166:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788652016.923984:0:17166:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788652016.923986:0:17166:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788652016.924105:0:17166:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f86c3255800 00000020:01000004:1.0:1788652016.924123:0:17166:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788652016.924130:0:17166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788652016.924143:0:17166:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8f85c20f99c0) 00000020:00000080:1.0:1788652016.924156:0:17166:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788652017.099451:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788652017.106823:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788652017.108547:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788652017.112199:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788652017.112472:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:3.0:1788652017.112872:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788652017.113170:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:3.0:1788652017.113382:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788652017.113815:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788652017.114156:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788652017.114371:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788652017.114610:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788652017.115401:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788652017.115689:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788652017.119250:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788652017.119779:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788652017.120026:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788652017.120494:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788652017.120710:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788652017.121032:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788652017.121374:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788652017.122185:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788652017.122566:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788652017.122858:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788652017.123387:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788652017.123652:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788652017.124801:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788652017.125236:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788652017.126023:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788652017.128040:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788652017.128816:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788652017.129159:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788652017.129511:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788652017.129722:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788652017.129952:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788652017.132223:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788652017.132662:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788652017.134345:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788652017.138650:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788652017.139497:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788652017.139951:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788652017.140227:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788652017.140473:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788652017.140854:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788652017.143414:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788652017.143838:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788652017.144708:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788652017.145892:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:2.0:1788652017.147288:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788652017.147937:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788652017.152547:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788652017.153488:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788652017.154748:0:17166:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:3.0:1788652017.155528:0:17166:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788652017.155767:0:17166:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788652017.155777:0:17166:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788652017.155790:0:17166:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c4ce0 00000020:01000004:3.0:1788652017.155797:0:17166:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788652017.155802:0:17166:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788652017.155807:0:17166:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f86c3255800 from MGS 00000020:01000004:3.0:1788652017.155811:0:17166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788652017.155821:0:17166:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8f85c2ae0000) 00000020:00000080:3.0:1788652017.155831:0:17166:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788652017.155892:0:17166:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86c3255800 from MGS, refs=2 00080000:01000000:3.0:1788652017.155897:0:17166:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788652017.155901:0:17166:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c4cee 00000100:00100000:3.0:1788652017.156074:0:17166:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788652017.156207:0:17166:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788652017.156214:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788652017.158405:0:17166:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788652017.158417:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788652017.164844:0:17166:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652017.165208:0:17166:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788652017.165216:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788652017.165896:0:17166:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788652017.165903:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788652017.166437:0:17166:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788652017.166444:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788652017.180082:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652017.180090:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652017.180093:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652017.197268:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652017.197276:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652017.197278:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652017.198287:0:17166:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788652017.200238:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788652017.213728:0:17166:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788652017.218347:0:17178:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788652017.218413:0:17166:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788652017.218475:0:17166:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788652017.220386:0:17166:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788652017.220719:0:17166:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652017.221052:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788652017.221060:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788652017.231507:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788652017.231526:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788652017.232160:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788652017.232167:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788652017.235097:0:17166:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788652017.235123:0:17166:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.145@tcp' 00000020:01000004:3.0:1788652017.235125:0:17166:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788652017.235155:0:17166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.145@tcp (typ=mgc) 00000020:00000080:3.0:1788652017.235166:0:17166:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.145@tcp (ffff8f85c2ae4d40) 00000020:00000080:3.0:1788652017.235181:0:17166:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788652017.235264:0:17166:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c3cb2000@MGC192.168.204.145@tcp: add connection 192.168.204.145@tcp at head 00010000:00010000:3.0:1788652017.235420:0:17166:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.145@tcp-0 is initialized 00000040:01000000:3.0:1788652017.235427:0:17166:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788652017.235925:0:17183:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788652017.235952:0:17184:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788652017.235978:0:17166:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.145@tcp (uuid a28e2822-101e-46fe-b9c1-7a60e90536a9) 00000020:00000080:2.0:1788652017.235993:0:17166:0:(genops.c:1385:class_connect()) connect: client a28e2822-101e-46fe-b9c1-7a60e90536a9, cookie 0xcd2f56ea038c4cfc 00000100:00080000:2.0:1788652017.236003:0:17166:0:(import.c:545:import_select_connection()) MGC192.168.204.145@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652017.236007:0:17166:0:(import.c:665:import_select_connection()) MGC192.168.204.145@tcp: import ffff8f85c3cb2000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652017.236038:0:17166:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff446680 x1875537147634304/t0(0) o250->MGC192.168.204.145@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652017.236070:0:17166:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a28e2822-101e-46fe-b9c1-7a60e90536a9->MGS 00000020:01000004:2.0:1788652017.236094:0:17166:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788652017.236099:0:17166:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788652017.236109:0:17166:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8f85c2934d40) 00000020:00000080:2.0:1788652017.236119:0:17166:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788652017.245084:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a28e2822-101e-46fe-b9c1-7a60e90536a9:3634:1875537147634304:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788652017.245162:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652017.245265:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147634304 00000100:00100000:3.0:1788652017.245273:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147634304 00000100:00100000:3.0:1788652017.245312:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652017.245319:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3634:x1875537147634304:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788652017.245347:0:17179:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a28e2822-101e-46fe-b9c1-7a60e90536a9@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:3.0:1788652017.245378:0:17179:0:(genops.c:1385:class_connect()) connect: client a28e2822-101e-46fe-b9c1-7a60e90536a9, cookie 0xcd2f56ea038c4d0a 00000100:00080000:3.0:1788652017.245528:0:17179:0:(import.c:65:import_set_state_nolock()) ffff8f85c3cb7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652017.245590:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+5:3634:x1875537147634304:12345-0@lo:250:mount.lustre.0 Request processed in 269us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652017.245598:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652017.246792:0:3634:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.145@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788652017.246805:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.204.145@tcp: connect to target with instance 0 00000100:00080000:1.0:1788652017.246814:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.204.145@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788652017.246819:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788652017.246824:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3cb2000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788652017.246839:0:3634:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788652017.246852:0:3634:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788652017.246859:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a28e2822-101e-46fe-b9c1-7a60e90536a9:3634:1875537147634304:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788652017.279166:0:17166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652017.279791:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788652017.279799:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788652017.282722:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788652017.282744:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788652017.284982:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788652017.284998:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788652017.287838:0:17166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652017.288405:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788652017.288414:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788652017.290079:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788652017.290090:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788652017.381850:0:17166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652017.382171:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788652017.382179:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788652017.394843:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788652017.394861:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788652017.399569:0:17166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652017.399755:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788652017.399762:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788652017.400629:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788652017.400638:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788652017.401212:0:17166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652017.401372:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788652017.401377:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788652017.401963:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788652017.401970:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788652017.407344:0:17166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652017.407541:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788652017.407547:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788652017.412039:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788652017.412071:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788652017.467698:0:17166:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652017.477281:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788652017.477295:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788652017.478701:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788652017.478714:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788652017.479551:0:17166:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788652017.479559:0:17166:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788652017.488635:0:17166:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788652017.488665:0:17166:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788652017.488671:0:17166:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788652017.488791:0:17166:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788652017.488827:0:17166:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.145@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788652017.488832:0:17166:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788652017.488833:0:17166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788652017.488835:0:17166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652017.488836:0:17166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652017.488837:0:17166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652017.488838:0:17166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652017.488839:0:17166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788652017.488841:0:17166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788652017.488842:0:17166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652017.488844:0:17166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788652017.488847:0:17166:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788652017.488849:0:17166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788652017.488850:0:17166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788652017.488851:0:17166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652017.488852:0:17166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652017.488853:0:17166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652017.488854:0:17166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652017.488856:0:17166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788652017.488857:0:17166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788652017.488858:0:17166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652017.488859:0:17166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788652017.488887:0:17166:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788652017.488943:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147634432:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788652017.489038:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652017.489108:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b8000 going to sleep for 11 seconds 00000100:00100000:0.0:1788652017.489347:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147634432 00000100:00100000:0.0:1788652017.489355:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147634432 00000100:00100000:0.0:1788652017.489393:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652017.489401:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+5:17166:x1875537147634432:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788652017.489457:0:17182:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788652017.489464:0:17182:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788652017.489467:0:17182:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788652017.496255:0:17202:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788652017.497035:0:17182:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:0.0:1788652017.502172:0:17203:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788652017.502182:0:17203:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788652017.502186:0:17203:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788652017.502188:0:17203:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788652017.502411:0:17203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788652017.503074:0:17182:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788652017.503085:0:17182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788652017.504717:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+5:17166:x1875537147634432:12345-0@lo:253:mount.lustre.0 Request processed in 15308us (15672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652017.504731:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652017.504865:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147634432:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788652017.504885:0:17166:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788652017.504888:0:17166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788652017.504890:0:17166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788652017.504892:0:17166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652017.504893:0:17166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652017.504895:0:17166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652017.504896:0:17166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652017.504898:0:17166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788652017.504900:0:17166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788652017.504901:0:17166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652017.504902:0:17166:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788652017.504966:0:17166:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f86c3255800 from lustre-MDT0000 10000000:01000000:2.0:1788652017.505000:0:17166:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788652017.505003:0:17166:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788652017.505008:0:17166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8f85c2ae4d40 10000000:01000000:2.0:1788652017.505013:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788652017.505020:0:17166:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8f85c2ae4d40 from 1 10000000:01000000:2.0:1788652017.505023:0:17166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788652017.505062:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.505074:0:17166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.505084:0:17166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652017.505105:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147634560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652017.505156:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652017.505190:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b8480 going to sleep for 11 seconds 00000100:00100000:0.0:1788652017.505280:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147634560 00000100:00100000:0.0:1788652017.505287:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147634560 00000100:00100000:0.0:1788652017.505331:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788652017.505340:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+5:17166:x1875537147634560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652017.505353:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652017.505368:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b96400/0xcd2f56ea038c4d18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4d11 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652017.505391:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b96400/0xcd2f56ea038c4d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4d11 expref: 6 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652017.505400:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b96400/0xcd2f56ea038c4d18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4d11 expref: 6 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652017.505409:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96400, rc 0) 00000100:00100000:0.0:1788652017.505447:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+6:17166:x1875537147634560:12345-0@lo:101:mount.lustre.0 Request processed in 109us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652017.505452:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652017.505992:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147634560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652017.506008:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.506016:0:17166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652017.506101:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147634688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652017.506134:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652017.506205:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d13b8480 going to sleep for 11 seconds 00000100:00100000:3.0:1788652017.512557:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147634688 00000100:00100000:3.0:1788652017.512574:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147634688 00000100:00100000:2.0:1788652017.512726:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652017.512737:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+6:17166:x1875537147634688:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652017.512885:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+6:17166:x1875537147634688:12345-0@lo:501:mount.lustre.0 Request processed in 148us (6749us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788652017.512892:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652017.514612:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147634688:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788652017.514665:0:17166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788652017.514694:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.514705:0:17166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652017.514720:0:17166:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f86c3255800 10000000:01000000:3.0:1788652017.514729:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788652017.514734:0:17166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f86c3255800 10000000:01000000:3.0:1788652017.514736:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788652017.514739:0:17166:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f86c3255800 from 1 10000000:01000000:3.0:1788652017.514751:0:17166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788652017.514796:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.514804:0:17166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.514814:0:17166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652017.514837:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147634816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652017.514956:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652017.514991:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652017.518638:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147634816 00000100:00100000:1.0:1788652017.518656:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147634816 00000100:00100000:1.0:1788652017.518714:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652017.518724:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+6:17166:x1875537147634816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652017.518741:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652017.518771:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f9a00/0xcd2f56ea038c4d26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4d1f expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.518799:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f9a00/0xcd2f56ea038c4d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4d1f expref: 7 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.518811:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f9a00/0xcd2f56ea038c4d26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4d1f expref: 7 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.518820:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9a00, rc 0) 00000100:00100000:1.0:1788652017.518898:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+7:17166:x1875537147634816:12345-0@lo:101:mount.lustre.0 Request processed in 175us (3941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652017.518905:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652017.519119:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147634816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652017.519138:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.519147:0:17166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652017.519168:0:17166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788652017.519188:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.519196:0:17166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f0907600/0xcd2f56ea038c4d1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d26 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652017.519204:0:17166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788652017.519208:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652017.519214:0:17166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f86c3255800 10000000:01000000:3.0:1788652017.519216:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788652017.519220:0:17166:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788652017.519222:0:17166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788652017.519247:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.519253:0:17166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.519261:0:17166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652017.519287:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147634944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652017.519323:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652017.519362:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4ac8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652017.519547:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147634944 00000100:00100000:2.0:1788652017.519553:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147634944 00000100:00100000:2.0:1788652017.519581:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652017.519589:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+7:17166:x1875537147634944:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652017.519596:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652017.519607:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c6600/0xcd2f56ea038c4d34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4d2d expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.519622:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c6600/0xcd2f56ea038c4d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4d2d expref: 8 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.519643:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c6600/0xcd2f56ea038c4d34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4d2d expref: 8 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.519650:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6600, rc 0) 00000100:00100000:2.0:1788652017.519698:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+8:17166:x1875537147634944:12345-0@lo:101:mount.lustre.0 Request processed in 111us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652017.519704:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788652017.519785:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147634944:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652017.519797:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652017.519804:0:17166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652017.519869:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147635072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652017.519897:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652017.519945:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c4eee6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652017.520000:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147635072 00000100:00100000:1.0:1788652017.520005:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147635072 00000100:00100000:1.0:1788652017.520026:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652017.520032:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+8:17166:x1875537147635072:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652017.520176:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+9:17166:x1875537147635072:12345-0@lo:501:mount.lustre.0 Request processed in 143us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652017.520189:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788652017.520306:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147635072:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652017.520334:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147635200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652017.520374:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652017.520396:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c4eee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652017.520448:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147635200 00000100:00100000:2.0:1788652017.520452:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147635200 00000100:00100000:2.0:1788652017.520470:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652017.520475:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+9:17166:x1875537147635200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652017.521589:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+9:17166:x1875537147635200:12345-0@lo:503:mount.lustre.0 Request processed in 1102us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652017.521597:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788652017.521692:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147635200:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652017.522137:0:17204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17204:1875537147635328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788652017.522180:0:17204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652017.522209:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86da5789c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652017.522315:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147635328 00000100:00100000:1.0:1788652017.522321:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147635328 00000100:00100000:1.0:1788652017.522361:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652017.522369:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+9:17204:x1875537147635328:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652017.523164:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+9:17204:x1875537147635328:12345-0@lo:502:llog_process_th.0 Request processed in 793us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652017.523172:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652017.523260:0:17204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17204:1875537147635328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788652017.523297:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652017.523311:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652017.523314:0:17204:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788652017.523320:0:17204:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788652017.523324:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652017.523343:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8f86fcd74d40) 00000020:00000080:0.0:1788652017.523363:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788652017.523369:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788652017.523468:0:17204:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788652017.523480:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c4d42 00000020:00000080:0.0:1788652017.523707:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788652017.523712:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652017.523716:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652017.523723:0:17204:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788652017.523726:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652017.523729:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652017.523731:0:17204:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788652017.523733:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652017.523741:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8f86fcd70000) 00000020:00000080:0.0:1788652017.523763:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788652017.523768:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788652017.523770:0:17204:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788652017.523772:0:17204:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788652017.523778:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788652017.523821:0:17204:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86c3255800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788652017.523834:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8f86fcd719c0) 00000020:00000080:0.0:1788652017.523841:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788652017.523896:0:17204:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788652017.523902:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c4d57 00000020:00000080:0.0:1788652017.524063:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788652017.524069:0:17204:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788652017.524073:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xcd2f56ea038c4d5e 00080000:01000000:0.0:1788652017.524078:0:17204:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788652017.524082:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c4d65 00010000:00010000:0.0:1788652017.670277:0:17204:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788652017.671828:0:17204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:0.0:1788652017.674972:0:17204:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788652017.675566:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8f86fcd73380) 00000020:00000080:0.0:1788652017.675589:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788652017.675677:0:17204:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788652017.675684:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c4d73 00000020:00000080:1.0:1788652017.680258:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788652017.697732:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xcd2f56ea038c4d7a 00000020:00000080:2.0:1788652017.699517:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788652017.699533:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652017.699542:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652017.699544:0:17204:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788652017.699548:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788652017.699552:0:17204:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788652017.699554:0:17204:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652017.699555:0:17204:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652017.699556:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788652017.699559:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652017.699561:0:17204:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788652017.699563:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652017.699569:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652017.699570:0:17204:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788652017.699576:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788652017.699657:0:17204:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788652017.699676:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652017.699679:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652017.699681:0:17204:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788652017.699684:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652017.699687:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652017.699689:0:17204:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788652017.699692:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788652017.699698:0:17204:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:00000080:2.0:1788652017.699729:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788652017.699754:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8f85c2933380) 00000020:00000080:2.0:1788652017.699771:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788652017.699776:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788652017.699835:0:17204:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788652017.699841:0:17204:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788652017.699847:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c4d88 00010000:00080000:2.0:1788652017.699894:0:17204:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c3fbc000@lustre-MDT0001-osp-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788652017.703842:0:17204:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:2.0:1788652017.705770:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788652017.705789:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788652017.705823:0:17204:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788652017.705845:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c4d8f 00000100:00080000:2.0:1788652017.705856:0:17204:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652017.705862:0:17204:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f85c3fbc000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652017.705988:0:17204:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff444e00 x1875537147635456/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652017.706050:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147635456:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788652017.706142:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652017.706262:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147635456 00000100:00100000:3.0:1788652017.706270:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147635456 00000100:00080000:2.0:1788652017.706278:0:17204:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788652017.706300:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652017.706309:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147635456:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1788652017.706323:0:17191:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000020:01000000:2.0:1788652017.706328:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652017.706332:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652017.706334:0:17204:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788652017.706350:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788652017.706352:0:17204:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788652017.706354:0:17204:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652017.706355:0:17204:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788652017.706356:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788652017.706359:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652017.706360:0:17204:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788652017.706362:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788652017.706367:0:17204:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788652017.706371:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652017.706372:0:17204:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788652017.706375:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788652017.706379:0:17204:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:01000000:2.0:1788652017.706399:0:17204:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788652017.706402:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788652017.706413:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8f85c29319c0) 00000020:00000080:2.0:1788652017.706424:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788652017.706428:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788652017.706485:0:17204:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788652017.706492:0:17204:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788652017.706498:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c4d9d 00010000:00080000:2.0:1788652017.706526:0:17204:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f86f67f3000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788652017.706752:0:17204:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788652017.720215:0:17204:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788652017.720439:0:17204:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788652017.728677:0:17204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652017.729399:0:17204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788652017.739994:0:17204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000100:00100000:3.0:1788652017.748620:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147635456:12345-0@lo:38:llog_process_th.0 Request processed in 42300us (42467us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788652017.748635:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1788652017.749153:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652017.749159:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788652017.749163:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147635456:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788652017.749996:0:17210:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788652017.750004:0:17210:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788652017.752523:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788652017.752537:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788652017.752576:0:17204:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788652017.752594:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c4da4 00000100:00080000:1.0:1788652017.752604:0:17204:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788652017.752611:0:17204:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f86f67f3000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652017.752644:0:17204:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c345b800 x1875537147635584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652017.752675:0:17204:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:0.0:1788652017.752758:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147635584:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788652017.752819:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147635584 offset 0 length 520: 4 00000020:01000000:1.0:1788652017.752964:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652017.752969:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.752971:0:17204:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788652017.752974:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788652017.752977:0:17204:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788652017.752978:0:17204:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788652017.752986:0:17204:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788652017.752987:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788652017.752990:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.752991:0:17204:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788652017.752993:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788652017.752997:0:17204:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788652017.753000:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.753002:0:17204:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788652017.753004:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788652017.753008:0:17204:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:01000000:1.0:1788652017.753027:0:17204:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788652017.753029:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788652017.753042:0:17204:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8f85c20f8000) 00000020:00000080:1.0:1788652017.753065:0:17204:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788652017.753072:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788652017.753255:0:17204:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788652017.753261:0:17204:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788652017.753267:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xcd2f56ea038c4db2 00010000:00080000:1.0:1788652017.753305:0:17204:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c373a800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:1.0:1788652017.753516:0:17204:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788652017.753589:0:17204:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788652017.753607:0:17204:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788652017.762557:0:17204:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652017.765976:0:17204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788652017.766402:0:17204:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788652017.766843:0:17212:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788652017.766848:0:17212:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788652017.767775:0:17204:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788652017.767788:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788652017.767825:0:17204:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788652017.767847:0:17204:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c4db9 00000100:00080000:1.0:1788652017.767857:0:17204:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788652017.769006:0:17204:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f85c373a800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652017.769237:0:17204:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c345aa00 x1875537147635712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788652017.769318:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147635712:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788652017.769411:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147635712 offset 0 length 520: 4 00000100:00080000:1.0:1788652017.772099:0:17204:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788652017.772229:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652017.772238:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.772241:0:17204:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788652017.772245:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652017.772249:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.772250:0:17204:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788652017.772254:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788652017.772256:0:17204:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788652017.772259:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652017.772262:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.772263:0:17204:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788652017.772265:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652017.772268:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.772269:0:17204:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788652017.772273:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788652017.772326:0:17204:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17204:1875537147635840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652017.772417:0:17204:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652017.772457:0:17204:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2ab8180 going to sleep for 11 seconds 00000100:00100000:2.0:1788652017.772678:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147635840 00000100:00100000:2.0:1788652017.772687:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147635840 00000100:00100000:2.0:1788652017.772756:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788652017.772766:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+9:17204:x1875537147635840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652017.772946:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+9:17204:x1875537147635840:12345-0@lo:502:llog_process_th.0 Request processed in 182us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652017.772955:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788652017.773289:0:17204:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17204:1875537147635840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788652017.773322:0:17204:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652017.773327:0:17204:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.773329:0:17204:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788652017.773334:0:17204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788652017.773517:0:17166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788652017.773542:0:17166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788652017.773571:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.773582:0:17166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f0907200/0xcd2f56ea038c4d2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d34 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652017.773591:0:17166:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86c3255800 from 1 10000000:01000000:3.0:1788652017.773594:0:17166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788652017.773624:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.773633:0:17166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.773653:0:17166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652017.773671:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147635968:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652017.773706:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652017.773746:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2dcbe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652017.773800:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147635968 00000100:00100000:1.0:1788652017.773806:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147635968 00000100:00100000:1.0:1788652017.773842:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652017.773851:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+9:17166:x1875537147635968:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652017.774717:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652017.774750:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c4dc7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4dc0 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.774778:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c4dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4dc0 expref: 10 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.774791:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c4dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4dc0 expref: 10 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.774799:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f8c00, rc 0) 00000100:00100000:1.0:1788652017.774862:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+10:17166:x1875537147635968:12345-0@lo:101:mount.lustre.0 Request processed in 1011us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652017.774880:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652017.775073:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147635968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652017.775099:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.775111:0:17166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652017.775725:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636096:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788652017.775789:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652017.775832:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34d3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652017.776221:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147636096 00000100:00100000:1.0:1788652017.776229:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147636096 00000100:00100000:1.0:1788652017.776270:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652017.776279:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+10:17166:x1875537147636096:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788652017.776300:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788652017.776308:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788652017.776393:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+10:17166:x1875537147636096:12345-0@lo:256:mount.lustre.0 Request processed in 115us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652017.776401:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652017.776494:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636096:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788652017.778421:0:17166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788652017.778456:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.778469:0:17166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652017.778479:0:17166:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86c3255800 from 1 10000000:01000000:2.0:1788652017.778483:0:17166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652017.778526:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.778548:0:17166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.778561:0:17166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652017.778585:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff444000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636224:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652017.778642:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652017.779549:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34d3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652017.788751:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147636224 00000100:00100000:1.0:1788652017.788771:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147636224 00000100:00100000:1.0:1788652017.788850:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788652017.788861:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+10:17166:x1875537147636224:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652017.788891:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652017.788945:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4dd5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4dce expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.788976:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4dce expref: 11 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.788989:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4dce expref: 11 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.788999:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9600, rc 0) 00000100:00100000:1.0:1788652017.792579:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:17166:x1875537147636224:12345-0@lo:101:mount.lustre.0 Request processed in 3710us (13926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652017.792592:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652017.792768:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff444000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652017.792797:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.792810:0:17166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652017.792933:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652017.792990:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652017.793101:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2dcbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652017.807445:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147636352 00000100:00100000:0.0:1788652017.807464:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147636352 00000100:00100000:0.0:1788652017.807539:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788652017.807549:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:17166:x1875537147636352:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652017.807829:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:17166:x1875537147636352:12345-0@lo:501:mount.lustre.0 Request processed in 280us (14837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652017.807837:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788652017.811149:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652017.811236:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652017.811328:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652017.811373:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652017.811858:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147636480 00000100:00100000:0.0:1788652017.811876:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147636480 00000100:00100000:0.0:1788652017.811965:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788652017.811975:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:17166:x1875537147636480:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652017.812124:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:17166:x1875537147636480:12345-0@lo:503:mount.lustre.0 Request processed in 150us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652017.812132:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788652017.812500:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652017.812962:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17214:1875537147636608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652017.813006:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652017.813044:0:17214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652017.813722:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147636608 00000100:00100000:3.0:1788652017.813729:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147636608 00000100:00100000:2.0:1788652017.813856:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788652017.813877:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:17214:x1875537147636608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652017.814542:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:17214:x1875537147636608:12345-0@lo:502:llog_process_th.0 Request processed in 676us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652017.814551:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788652017.814683:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17214:1875537147636608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788652017.814715:0:17214:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652017.814725:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.814727:0:17214:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788652017.814735:0:17214:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86c3255800 00000020:00000080:1.0:1788652017.814748:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788652017.814765:0:17214:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652017.814767:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.814769:0:17214:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788652017.814772:0:17214:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652017.814774:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.814775:0:17214:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788652017.814778:0:17214:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86c3255800 00000020:00000080:1.0:1788652017.814780:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788652017.814893:0:17214:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652017.814898:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.814899:0:17214:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788652017.814902:0:17214:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652017.814904:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.814935:0:17214:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788652017.814941:0:17214:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86c3255800 00000020:00000080:1.0:1788652017.814943:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788652017.820318:0:17214:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652017.820331:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.820334:0:17214:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788652017.820338:0:17214:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652017.820343:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652017.820344:0:17214:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788652017.820350:0:17214:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86c3255800 00000020:00000080:1.0:1788652017.820352:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788652017.820447:0:17214:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17214:1875537147636736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652017.820533:0:17214:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652017.823344:0:17214:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652017.835002:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147636736 00000100:00100000:2.0:1788652017.835015:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147636736 00000100:00100000:2.0:1788652017.835099:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788652017.835110:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:17214:x1875537147636736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652017.835265:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:17214:x1875537147636736:12345-0@lo:502:llog_process_th.0 Request processed in 157us (14732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652017.835272:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788652017.843491:0:17214:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17214:1875537147636736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788652017.843549:0:17214:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652017.843561:0:17214:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652017.843563:0:17214:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788652017.843576:0:17214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788652017.843843:0:17166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788652017.843880:0:17166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788652017.843896:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.843924:0:17166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652017.843983:0:17166:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788652017.843994:0:17166:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f86c3255800 10000000:01000000:3.0:1788652017.843998:0:17166:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f86c3255800 10000000:01000000:3.0:1788652017.844002:0:17166:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652017.844008:0:17166:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86c3255800 from 1 10000000:01000000:3.0:1788652017.844011:0:17166:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788652017.844262:0:17166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.844272:0:17166:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.844281:0:17166:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652017.844303:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636864:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652017.844366:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652017.844401:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2dcb900 going to sleep for 11 seconds 00000100:00100000:2.0:1788652017.848928:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147636864 00000100:00100000:2.0:1788652017.848946:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147636864 00000100:00100000:2.0:1788652017.849005:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788652017.849017:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:17166:x1875537147636864:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652017.849036:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652017.849068:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c7600/0xcd2f56ea038c4de3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4ddc expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.849107:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c7600/0xcd2f56ea038c4de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4ddc expref: 12 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.849120:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c7600/0xcd2f56ea038c4de3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4ddc expref: 12 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.849129:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7600, rc 0) 00000100:00100000:2.0:1788652017.849208:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17166:x1875537147636864:12345-0@lo:101:mount.lustre.0 Request processed in 193us (4840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652017.849217:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788652017.849636:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636864:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652017.849659:0:17166:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652017.849669:0:17166:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652017.849774:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636992:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652017.849815:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652017.849871:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2dcb900 going to sleep for 11 seconds 00000100:00100000:2.0:1788652017.852706:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147636992 00000100:00100000:2.0:1788652017.852722:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147636992 00000100:00100000:2.0:1788652017.852792:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788652017.852802:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17166:x1875537147636992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652017.853023:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17166:x1875537147636992:12345-0@lo:501:mount.lustre.0 Request processed in 222us (3207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652017.853032:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788652017.859479:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147636992:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652017.859563:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147637120:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652017.859653:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652017.859706:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788652017.859849:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147637120 00000100:00100000:2.0:1788652017.859858:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147637120 00000100:00100000:2.0:1788652017.859950:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788652017.859967:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17166:x1875537147637120:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652017.860111:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17166:x1875537147637120:12345-0@lo:503:mount.lustre.0 Request processed in 145us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652017.860119:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788652017.863829:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147637120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652017.870347:0:17219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17219:1875537147637248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652017.870447:0:17219:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652017.870499:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147637248 00000100:00100000:1.0:1788652017.870507:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147637248 00000100:00100000:1.0:1788652017.870557:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788652017.870575:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17219:x1875537147637248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652017.870707:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17219:x1875537147637248:12345-0@lo:502:llog_process_th.0 Request processed in 134us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652017.870716:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788652017.870787:0:17219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788652017.870811:0:17219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17219:1875537147637248:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788652017.870891:0:17219:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788652017.870931:0:17219:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8f85c20fcd40) 00000020:00000080:1.0:1788652017.870955:0:17219:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788652017.871040:0:17219:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86c3255800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788652017.871045:0:17219:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86c3255800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788652017.871048:0:17219:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86c3255800 4 00010000:00080000:1.0:1788652017.871083:0:17219:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f86f67f2000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.145@tcp at head 00010000:00010000:1.0:1788652017.872695:0:17219:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788652017.881763:0:17219:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788652017.881812:0:17219:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788652017.881830:0:17219:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xcd2f56ea038c4df1 00000100:00080000:1.0:1788652017.881842:0:17219:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788652017.881848:0:17219:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f86f67f2000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652017.881939:0:17219:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c345b100 x1875537147637376/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652017.881969:0:17219:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788652017.882701:0:17219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17219:1875537147637504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652017.882803:0:17219:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652017.882847:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147637504 00000100:00100000:2.0:1788652017.882855:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147637504 00000100:00100000:2.0:1788652017.882927:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788652017.882937:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17219:x1875537147637504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652017.883616:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17219:x1875537147637504:12345-0@lo:502:llog_process_th.0 Request processed in 680us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652017.883625:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788652017.883684:0:17219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34d3a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788652017.883707:0:17219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17219:1875537147637504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652017.883770:0:17219:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17219:1875537147637632:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788652017.883809:0:17219:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652017.883827:0:17219:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34d3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652017.884216:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147637376:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788652017.884260:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652017.884564:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147637632 00000100:00100000:1.0:1788652017.884571:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147637632 00000100:00100000:1.0:1788652017.884610:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788652017.884619:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17219:x1875537147637632:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788652017.884721:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17219:x1875537147637632:12345-0@lo:502:llog_process_th.0 Request processed in 103us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652017.884735:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652017.885616:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147637376 00000100:00100000:2.0:1788652017.885623:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147637376 00000100:00100000:2.0:1788652017.885647:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652017.885652:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147637376:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788652017.885726:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147637376:12345-0@lo:38:llog_process_th.0 Request processed in 72us (1465us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788652017.885734:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652017.885810:0:17219:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a28e2822-101e-46fe-b9c1-7a60e90536a9:17219:1875537147637632:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788652017.885849:0:17219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:0.0:1788652017.885992:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788652017.886000:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652017.886004:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788652017.886008:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147637376:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788652017.886388:0:17166:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788652017.886415:0:17166:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788652017.886436:0:17166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652017.886447:0:17166:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f0906e00/0xcd2f56ea038c4ddc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4de3 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788652017.886511:0:17166:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788652017.886513:0:17166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788652017.886514:0:17166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652017.886515:0:17166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652017.886517:0:17166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652017.886518:0:17166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652017.886519:0:17166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788652017.886521:0:17166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788652017.886522:0:17166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652017.886523:0:17166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652017.886528:0:17166:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788652017.886530:0:17166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788652017.886531:0:17166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788652017.886532:0:17166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652017.886533:0:17166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652017.886534:0:17166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652017.886536:0:17166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652017.886537:0:17166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788652017.886538:0:17166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788652017.886539:0:17166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652017.886540:0:17166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652017.886561:0:17166:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788652017.886578:0:17166:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147637760:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788652017.886629:0:17166:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652017.886664:0:17166:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788652017.886768:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147637760 00000100:00100000:1.0:1788652017.886774:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147637760 00000100:00100000:1.0:1788652017.886814:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788652017.886821:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17166:x1875537147637760:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788652017.886843:0:17179:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788652017.886855:0:17179:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788652017.894060:0:17179:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788652017.894077:0:17179:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788652017.897745:0:17202:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788652017.897758:0:17202:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788652017.897789:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.897810:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c4dc7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4dc0 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.897819:0:17202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.898196:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c4dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4dc0 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652017.898217:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c4dc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dc0 expref: 12 pid: 17181 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652017.898239:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147637888:0@lo:104: 00000100:00100000:2.0:1788652017.898323:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652017.898383:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34d3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788652017.898597:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17166:x1875537147637760:12345-0@lo:253:mount.lustre.0 Request processed in 11774us (11965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652017.898608:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788652017.898760:0:17166:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17166:1875537147637760:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788652017.898776:0:17166:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788652017.898779:0:17166:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788652017.898781:0:17166:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788652017.898782:0:17166:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652017.898783:0:17166:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652017.898785:0:17166:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652017.898786:0:17166:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652017.898788:0:17166:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788652017.898803:0:17166:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788652017.898805:0:17166:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652017.898806:0:17166:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788652017.898821:0:17166:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788652017.906642:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147637888 00000100:00100000:0.0:1788652017.906661:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147637888 00000100:00100000:0.0:1788652017.906779:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652017.906789:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:17202:x1875537147637888:12345-0@lo:104: 00010000:00010000:0.0:1788652017.906808:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652017.906940:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788652017.906946:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:17202:x1875537147637888:12345-0@lo:104: Request processed in 160us (8623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652017.906954:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788652017.907043:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147637888:0@lo:104: 00010000:00010000:3.0:1788652017.908261:0:17202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.908502:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652017.908511:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.908519:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652017.908524:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.908534:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652017.908543:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652017.908549:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788652017.908595:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.908613:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652017.908639:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.908646:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4dc0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4dc7 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.908666:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652017.908668:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652017.908670:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652017.908710:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147638016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652017.908781:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652017.909340:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147638016 00000100:00100000:1.0:1788652017.909348:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147638016 00010000:00010000:1.0:1788652017.909378:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c4dc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dc0 expref: 12 pid: 17181 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652017.909417:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788652017.909426:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:3638:x1875537147638016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652017.909439:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652017.909445:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c4dc7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dc0 expref: 12 pid: 17181 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.909456:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c4dc7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dc0 expref: 12 pid: 17181 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.909472:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c4dc7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4dc0 expref: 12 pid: 17181 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.909499:0:17172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.909508:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788652017.909523:0:17172:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011767327s 00010000:00010000:1.0:1788652017.909528:0:17172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.909533:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.909541:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.909547:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.909553:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652017.909557:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.909565:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.909582:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.910363:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652017.910449:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:3638:x1875537147638016:12345-0@lo:103:ldlm_bl.0 Request processed in 1021us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652017.910457:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788652017.910496:0:17202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.910505:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652017.910511:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c4df8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652017.910555:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147638016:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788652017.952989:0:17166:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788652017.953367:0:17166:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788652017.953504:0:17224:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788652017.953509:0:17224:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788652017.953612:0:17225:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788652017.953972:0:17166:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1788652017.956310:0:17225:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788652017.959070:0:17226:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8f86ff445c00 x1875537147638144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652017.959094:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00000040:01000000:3.0:1788652017.959585:0:17166:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788652017.959628:0:17166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788652017.960554:0:17166:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788652017.960566:0:17166:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788652017.960618:0:17166:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652017.962804:0:17225:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788652017.962880:0:17225:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:3.0:1788652017.964944:0:17166:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788652017.971716:0:17166:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788652017.972292:0:17166:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788652017.976228:0:17166:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788652017.978714:0:17166:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788652017.986778:0:17166:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788652017.986815:0:17166:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa71c016e3988 00100000:10000000:0.0:1788652017.986824:0:17166:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788652017.987589:0:17166:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788652017.987604:0:17166:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788652017.987619:0:17166:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788652017.987640:0:17166:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:3.0:1788652018.013708:0:17166:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652018.016405:0:17166:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788652018.213531:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788652018.463975:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788652018.463984:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86c3255800 from 7 10000000:01000000:1.0:1788652018.463990:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788652018.464044:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652018.464057:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652018.464070:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652018.464099:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147638272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788652018.464176:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652018.464240:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788652018.474771:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147638272 00000100:00100000:0.0:1788652018.474789:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147638272 00000100:00100000:0.0:1788652018.474948:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652018.474962:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+11:17184:x1875537147638272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652018.474984:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652018.475012:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4e06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4dff expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652018.475041:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4dff expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652018.475054:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4dff expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652018.475063:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97600, rc 0) 00000100:00100000:0.0:1788652018.475147:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17184:x1875537147638272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (10970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652018.475153:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652018.477280:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147638272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652018.477309:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652018.477321:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652018.477398:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147638400:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788652018.477465:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652018.477513:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef240 going to sleep for 11 seconds 00000100:00100000:2.0:1788652018.477587:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147638400 00000100:00100000:2.0:1788652018.477595:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147638400 00000100:00100000:2.0:1788652018.477648:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788652018.477658:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17184:x1875537147638400:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788652018.477680:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788652018.477699:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788652018.477702:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788652018.477802:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17184:x1875537147638400:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652018.477810:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788652018.477847:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147638400:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788652018.477893:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788652018.477901:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652018.477931:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652018.912650:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788652018.976535:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652019.236994:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788652019.939370:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788652020.004542:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652020.264353:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652021.027106:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652021.299747:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652022.048086:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652022.309824:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652023.073103:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00000100:00080000:2.0:1788652023.265051:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788652023.265058:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788652023.265064:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788652023.265073:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:2.0:1788652023.265079:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788652023.265086:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f85c3fbc000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652023.265112:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff446300 x1875537147638656/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652023.265132:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652023.265137:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788652023.265150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652023.265153:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788652023.265156:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788652023.265160:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00100000:3.0:1788652023.265162:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147638528:0@lo:400:kworker.0 00000100:00080000:2.0:1788652023.265163:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788652023.265172:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8f86f67f2000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652023.265187:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff445880 x1875537147638784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652023.265260:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652023.265430:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147638528 00000100:00100000:2.0:1788652023.265440:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147638528 00000100:00100000:2.0:1788652023.265499:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788652023.265509:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:3635:x1875537147638528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652023.265565:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:3635:x1875537147638528:12345-0@lo:400:kworker.0 Request processed in 57us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652023.265582:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788652023.265642:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147638528:0@lo:400:kworker.0 00000100:00100000:0.0:1788652023.266893:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147638656:0@lo:38:kworker.0 00000100:00100000:0.0:1788652023.267079:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652023.267128:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147638784:0@lo:38:kworker.0 00000100:00100000:0.0:1788652023.267157:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652023.267209:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147638784 00000100:00100000:0.0:1788652023.267391:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147638784 00000100:00100000:0.0:1788652023.267431:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652023.267439:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875537147638784:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788652023.267468:0:17188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:0.0:1788652023.267616:0:17188:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xcd2f56ea038c4e0d 00000004:00100000:0.0:1788652023.267645:0:17188:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788652023.267778:0:17188:0:(import.c:65:import_set_state_nolock()) ffff8f86eeabf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652023.267831:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3634:x1875537147638784:12345-0@lo:38:kworker.0 Request processed in 391us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652023.267838:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788652023.267953:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f86ff445880 x1875537147638784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788652023.267968:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788652023.267975:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788652023.267980:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788652023.267982:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788652023.267987:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3634:1875537147638784:0@lo:38:kworker.0 00000100:00100000:2.0:1788652023.270902:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147638656 00000100:00100000:2.0:1788652023.270949:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147638656 00000100:00100000:2.0:1788652023.270990:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652023.270998:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875537147638656:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788652023.271020:0:17192:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788652023.289786:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875537147638656:12345-0@lo:38:kworker.0 Request processed in 18782us (22701us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788652023.289803:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788652023.290387:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788652023.290394:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788652023.290398:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147638656:0@lo:38:kworker.0 00010000:00010000:0.0:1788652023.328358:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788652023.762584:0:17470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788652024.096000:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652024.355401:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788652025.044539:0:17522:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652025.044849:0:17522:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788652025.121263:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652025.376943:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788652026.092214:0:17572:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788652026.092437:0:17572:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788652026.154390:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652026.401382:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652027.168213:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00000100:00100000:2.0:1788652027.361707:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652017/real 1788652017] req@ffff8f85c345aa00 x1875537147635712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652027 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652027.361744:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f85c345aa00 x1875537147635712/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652027 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652027.361756:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652017/real 1788652017] req@ffff8f85c345b800 x1875537147635584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652027 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652027.361769:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f85c345b800 x1875537147635584/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652027 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788652027.361788:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788652027.361808:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788652027.361813:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147635712:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788652027.361836:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788652027.361842:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788652027.361846:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147635584:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788652027.362881:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788652027.362887:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788652027.362890:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652027.362904:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 479 00000100:00080000:0.0:1788652027.362930:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788652027.362938:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f85c3fbc000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652027.362961:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d1180 x1875537147639040/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652027.363100:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652027.363115:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147638912:0@lo:400:kworker.0 00000100:00100000:1.0:1788652027.363186:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788652027.363322:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652027.363326:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788652027.363328:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652027.363331:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1788652027.363335:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788652027.363339:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f86f67f3000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652027.363354:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d1f80 x1875537147639168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788652027.363362:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652027.363365:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788652027.363367:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652027.363370:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1788652027.363372:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788652027.363375:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f85c373a800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652027.363385:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d3480 x1875537147639296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788652027.363433:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147638912 00000100:00100000:0.0:1788652027.363440:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147638912 00000100:00100000:0.0:1788652027.363483:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788652027.363492:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:3635:x1875537147638912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652027.363562:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:3635:x1875537147638912:12345-0@lo:400:kworker.0 Request processed in 62us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652027.363570:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788652027.363601:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788652027.363610:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147639424:0@lo:400:kworker.0 00000100:00100000:0.0:1788652027.363637:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652027.363678:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147639424 00000100:00100000:0.0:1788652027.363682:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147639424 00000100:00100000:0.0:1788652027.363710:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652027.363717:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147639424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652027.363752:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147639424:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652027.363758:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788652027.363793:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f86f48d1880 x1875537147639424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652027.363806:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147639424:0@lo:400:kworker.0 00000100:00100000:0.0:1788652027.363831:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147638912:0@lo:400:kworker.0 00000100:00100000:2.0:1788652027.363887:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147639040:0@lo:38:kworker.0 00000100:00100000:2.0:1788652027.363948:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652027.364043:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147639168:0@lo:8:kworker.0 00000400:00000100:2.0:1788652027.364066:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147639168 offset 0 length 520: 4 00000100:00100000:2.0:1788652027.364086:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147639296:0@lo:8:kworker.0 00000400:00000100:2.0:1788652027.364103:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147639296 offset 0 length 520: 4 00000100:00100000:0.0:1788652027.366538:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147639040 00000100:00100000:0.0:1788652027.366567:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147639040 00000100:00100000:0.0:1788652027.366614:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788652027.366623:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147639040:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788652027.366644:0:17191:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788652027.407858:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3634:x1875537147639040:12345-0@lo:38:kworker.0 Request processed in 41225us (43899us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788652027.407889:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788652027.408376:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652027.408382:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788652027.408397:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147639040:0@lo:38:kworker.0 00010000:00010000:1.0:1788652027.425419:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652028.191970:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652028.452433:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788652029.161428:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788652029.216069:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:1.0:1788652029.472367:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652030.242101:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652030.503070:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652031.266542:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:1.0:1788652031.521156:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652032.288063:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00000100:00080000:3.0:1788652032.480259:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:1.0:1788652032.480261:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1788652032.480266:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00100000:1.0:1788652032.480278:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147639552:0@lo:400:kworker.0 00000100:00100000:1.0:1788652032.480362:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788652032.480422:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652032.480428:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:3.0:1788652032.480434:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788652032.480442:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f85c3fbc000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652032.480476:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff463480 x1875537147639680/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652032.480497:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652032.480501:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652032.480504:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652032.480506:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788652032.480547:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147639552 00000100:00100000:3.0:1788652032.480554:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147639552 00000100:00100000:3.0:1788652032.480617:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788652032.480630:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:3637:x1875537147639552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652032.480705:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:3637:x1875537147639552:12345-0@lo:400:kworker.0 Request processed in 77us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652032.480713:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788652032.480746:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147639808:0@lo:400:kworker.0 00000100:00100000:0.0:1788652032.480859:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147639680:0@lo:38:kworker.0 00000100:00100000:0.0:1788652032.480889:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652032.480971:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147639680 00000100:00100000:0.0:1788652032.480975:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147639680 00000100:00100000:0.0:1788652032.480992:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788652032.480997:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875537147639680:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788652032.481013:0:17192:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788652032.481845:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147639552:0@lo:400:kworker.0 00000100:00100000:3.0:1788652032.483918:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652032.484241:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147639808 00000100:00100000:1.0:1788652032.484251:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147639808 00000100:00100000:1.0:1788652032.484306:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652032.484315:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147639808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652032.484388:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147639808:12345-0@lo:400:kworker.0 Request processed in 74us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652032.484395:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788652032.484437:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f86ff463100 x1875537147639808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652032.484452:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147639808:0@lo:400:kworker.0 00000100:00100000:0.0:1788652032.499437:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875537147639680:12345-0@lo:38:kworker.0 Request processed in 18429us (18537us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788652032.499451:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788652032.499589:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652032.499595:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788652032.499599:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147639680:0@lo:38:kworker.0 00010000:00010000:0.0:1788652032.544807:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652033.313848:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00000020:01000004:0.0:1788652033.390427:0:17917:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788652033.390433:0:17917:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788652033.390435:0:17917:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788652033.390554:0:17917:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f85c3548800 00000020:01000004:0.0:1788652033.390569:0:17917:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788652033.390581:0:17917:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788652033.390607:0:17917:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8f86eeba8000) 00000020:00000080:0.0:1788652033.390630:0:17917:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788652033.436097:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788652033.436536:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788652033.437774:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788652033.438006:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788652033.438222:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788652033.438550:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788652033.438821:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788652033.439092:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788652033.439404:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788652033.439631:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788652033.439856:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788652033.440187:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788652033.440465:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788652033.440697:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788652033.440869:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788652033.441339:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1788652033.441586:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788652033.441819:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788652033.442020:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788652033.442202:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1788652033.442541:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788652033.442727:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788652033.443051:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788652033.443241:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788652033.443567:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1788652033.443819:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788652033.444027:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1788652033.444338:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788652033.444538:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1788652033.444729:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1788652033.445055:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1788652033.445349:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1788652033.445565:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1788652033.445770:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788652033.446176:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788652033.446610:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788652033.446818:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788652033.447147:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788652033.447418:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1788652033.447644:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788652033.447867:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788652033.448095:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788652033.448362:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788652033.448585:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1788652033.448822:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788652033.449134:0:17917:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:01000000:2.0:1788652033.451855:0:17917:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788652033.452257:0:17917:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788652033.452269:0:17917:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788652033.452280:0:17917:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c4e1b 00000020:01000004:2.0:1788652033.452286:0:17917:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788652033.452306:0:17917:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788652033.452309:0:17917:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788652033.452316:0:17917:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788652033.452342:0:17917:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788652033.452346:0:17917:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1788652033.457049:0:17917:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788652033.457089:0:17917:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.204.145@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1788652033.457093:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788652033.457095:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788652033.457097:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652033.457098:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652033.457099:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652033.457100:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652033.457101:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788652033.457103:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652033.457105:0:17917:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652033.457108:0:17917:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1788652033.457111:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788652033.457112:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788652033.457113:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652033.457119:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652033.457120:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652033.457121:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652033.457122:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788652033.457123:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652033.457124:0:17917:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788652033.457153:0:17917:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1788652033.457173:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147639936:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788652033.457326:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652033.457433:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f096b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652033.457486:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147639936 00000100:00100000:0.0:1788652033.457493:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147639936 00000100:00100000:0.0:1788652033.457591:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788652033.457602:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17917:x1875537147639936:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788652033.457632:0:17182:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788652033.457635:0:17182:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:0.0:1788652033.457642:0:17182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:0.0:1788652033.457982:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17917:x1875537147639936:12345-0@lo:253:mount.lustre.0 Request processed in 380us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.457990:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788652033.458083:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147639936:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788652033.458094:0:17917:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788652033.458096:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788652033.458098:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788652033.458100:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788652033.458101:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788652033.458102:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788652033.458103:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788652033.458104:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788652033.458106:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788652033.458107:0:17917:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788652033.458127:0:17917:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f85c3548800 from lustre-MDT0001 10000000:01000000:3.0:1788652033.458154:0:17917:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788652033.458156:0:17917:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788652033.458163:0:17917:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f85c2ae4d40 local copy 00010000:00010000:3.0:1788652033.458176:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652033.458277:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652033.458304:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652033.460545:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147640064 00000100:00100000:0.0:1788652033.460560:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147640064 00000100:00100000:0.0:1788652033.460605:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788652033.460614:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17917:x1875537147640064:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652033.460719:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17917:x1875537147640064:12345-0@lo:501:mount.lustre.0 Request processed in 105us (2413us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788652033.460727:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788652033.460883:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f096ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652033.460919:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640064:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788652033.460943:0:17917:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788652033.460982:0:17917:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788652033.460990:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.461000:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652033.461029:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f85c3548800 10000000:01000000:3.0:1788652033.461034:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788652033.461039:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8f85c2ae4d40 10000000:01000000:3.0:1788652033.461042:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788652033.461046:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8f85c2ae4d40 from 1 10000000:01000000:3.0:1788652033.461048:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788652033.461079:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907a00/0xcd2f56ea038c4e22 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.461087:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f0907a00/0xcd2f56ea038c4e22 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.461096:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f0907a00/0xcd2f56ea038c4e22 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652033.461112:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652033.461143:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652033.461167:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f096ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652033.461228:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147640192 00000100:00100000:0.0:1788652033.461232:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147640192 00000100:00100000:0.0:1788652033.461271:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788652033.461278:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+12:17917:x1875537147640192:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652033.461288:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652033.461300:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b97e00/0xcd2f56ea038c4e29 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4e22 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.461318:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b97e00/0xcd2f56ea038c4e29 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4e22 expref: 13 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.461339:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b97e00/0xcd2f56ea038c4e29 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4e22 expref: 13 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.461347:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97e00, rc 0) 00000100:00100000:0.0:1788652033.461376:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+13:17917:x1875537147640192:12345-0@lo:101:mount.lustre.0 Request processed in 98us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.461381:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788652033.461514:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652033.461527:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f0907a00/0xcd2f56ea038c4e22 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e29 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.461536:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f0907a00/0xcd2f56ea038c4e22 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4e29 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652033.461556:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788652033.461575:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907a00/0xcd2f56ea038c4e22 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e29 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.461582:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f0907a00/0xcd2f56ea038c4e22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e29 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652033.461588:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8f85c3548800 10000000:01000000:3.0:1788652033.461592:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788652033.461595:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8f85c3548800 from 1 10000000:01000000:3.0:1788652033.461597:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788652033.461610:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.461616:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.461623:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652033.461634:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640320:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652033.461658:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652033.461674:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f096ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652033.461726:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147640320 00000100:00100000:0.0:1788652033.461731:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147640320 00000100:00100000:0.0:1788652033.461847:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788652033.461855:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+13:17917:x1875537147640320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652033.461863:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652033.461873:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b97800/0xcd2f56ea038c4e37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4e30 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.461887:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b97800/0xcd2f56ea038c4e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4e30 expref: 14 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.461897:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b97800/0xcd2f56ea038c4e37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4e30 expref: 14 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.461904:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97800, rc 0) 00000100:00100000:0.0:1788652033.461958:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+14:17917:x1875537147640320:12345-0@lo:101:mount.lustre.0 Request processed in 104us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.461964:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788652033.462141:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640320:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652033.462152:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.462161:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652033.462179:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788652033.462194:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.462201:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f0907c00/0xcd2f56ea038c4e30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e37 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652033.462207:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788652033.462211:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652033.462215:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8f85c3548800 10000000:01000000:3.0:1788652033.462218:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788652033.462221:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788652033.462223:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788652033.462236:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.462251:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.462258:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652033.462270:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652033.462294:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652033.462314:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147640448 00000100:00100000:3.0:1788652033.462317:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147640448 00000100:00100000:3.0:1788652033.462336:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788652033.462342:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+14:17917:x1875537147640448:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652033.462354:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652033.462364:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f0906600/0xcd2f56ea038c4e45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4e3e expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.462377:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f0906600/0xcd2f56ea038c4e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4e3e expref: 15 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.462386:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f0906600/0xcd2f56ea038c4e45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4e3e expref: 15 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.462392:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906600, rc 0) 00000100:00100000:3.0:1788652033.462414:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+15:17917:x1875537147640448:12345-0@lo:101:mount.lustre.0 Request processed in 72us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652033.462420:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788652033.462457:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f096ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652033.462469:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652033.462477:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.462485:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652033.464094:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:3.0:1788652033.464620:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652033.468786:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788652033.468844:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1788652033.468860:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1788652033.468873:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1788652033.468888:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1788652033.468952:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1788652033.468969:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1788652033.468982:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1788652033.468995:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1788652033.469008:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1788652033.469020:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1788652033.469033:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1788652033.469045:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1788652033.469059:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1788652033.469072:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1788652033.469084:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1788652033.469097:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1788652033.469113:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1788652033.469127:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1788652033.469140:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1788652033.469154:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1788652033.469168:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1788652033.469180:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1788652033.469207:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1788652033.469213:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1788652033.469455:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652033.469522:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652033.469576:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f096b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788652033.469718:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147640576 00000100:00100000:0.0:1788652033.469726:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147640576 00000100:00100000:0.0:1788652033.469800:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788652033.469809:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+15:17917:x1875537147640576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652033.469981:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+15:17917:x1875537147640576:12345-0@lo:501:mount.lustre.0 Request processed in 173us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.469989:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788652033.470214:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640576:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652033.470258:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640704:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652033.470301:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652033.470320:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f096b180 going to sleep for 11 seconds 00000100:00100000:0.0:1788652033.470424:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147640704 00000100:00100000:0.0:1788652033.470429:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147640704 00000100:00100000:0.0:1788652033.470474:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788652033.470481:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+15:17917:x1875537147640704:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788652033.471048:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+15:17917:x1875537147640704:12345-0@lo:503:mount.lustre.0 Request processed in 564us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.471057:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788652033.471224:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640704:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788652033.471635:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788652033.471711:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652033.471770:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652033.471804:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2b31c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788652033.472007:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147640832 00000100:00100000:3.0:1788652033.472013:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147640832 00000100:00100000:3.0:1788652033.472050:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788652033.472065:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+15:17917:x1875537147640832:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652033.472671:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+15:17917:x1875537147640832:12345-0@lo:502:mount.lustre.0 Request processed in 605us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652033.472680:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788652033.472886:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652033.473679:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788652033.473714:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:2.0:1788652033.473730:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:2.0:1788652033.473744:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:2.0:1788652033.473771:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:2.0:1788652033.473785:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:2.0:1788652033.473797:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:2.0:1788652033.473810:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:2.0:1788652033.473824:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:2.0:1788652033.473836:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:2.0:1788652033.473849:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:2.0:1788652033.473863:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:2.0:1788652033.473876:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:2.0:1788652033.473892:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:2.0:1788652033.473903:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:2.0:1788652033.473951:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:2.0:1788652033.473966:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:2.0:1788652033.473980:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:2.0:1788652033.473994:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:2.0:1788652033.474005:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:2.0:1788652033.474018:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:2.0:1788652033.474032:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:2.0:1788652033.474045:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:2.0:1788652033.474060:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:2.0:1788652033.474071:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:2.0:1788652033.474094:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:2.0:1788652033.474108:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:2.0:1788652033.474122:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:2.0:1788652033.474134:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:2.0:1788652033.474145:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:2.0:1788652033.474158:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:2.0:1788652033.474174:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:2.0:1788652033.474185:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:2.0:1788652033.474198:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:2.0:1788652033.474211:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:2.0:1788652033.474224:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:2.0:1788652033.474238:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:2.0:1788652033.474266:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:2.0:1788652033.474282:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:2.0:1788652033.474296:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:2.0:1788652033.474307:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:2.0:1788652033.474320:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:2.0:1788652033.474333:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:2.0:1788652033.474347:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:2.0:1788652033.474391:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640960:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652033.474473:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652033.474525:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef180 going to sleep for 11 seconds 00000100:00100000:1.0:1788652033.474682:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147640960 00000100:00100000:1.0:1788652033.474691:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147640960 00000100:00100000:1.0:1788652033.474743:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788652033.474759:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+15:17917:x1875537147640960:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652033.474879:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+15:17917:x1875537147640960:12345-0@lo:502:mount.lustre.0 Request processed in 121us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.474887:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788652033.475101:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147640960:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652033.475148:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:2.0:1788652033.475157:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788652033.476608:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652033.476621:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652033.476623:0:17921:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788652033.476630:0:17921:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788652033.476633:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788652033.476647:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8f85c2ae3380) 00000020:00000080:3.0:1788652033.476670:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788652033.476677:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788652033.476823:0:17921:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788652033.476832:0:17921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c4e53 00000020:00000080:3.0:1788652033.477185:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788652033.477190:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652033.477194:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652033.477196:0:17921:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788652033.477199:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652033.477203:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652033.477204:0:17921:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788652033.477208:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788652033.477215:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8f85c2ae19c0) 00000020:00000080:3.0:1788652033.477226:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788652033.477230:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788652033.477232:0:17921:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788652033.477235:0:17921:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788652033.477242:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788652033.477383:0:17921:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f85c3548800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788652033.477396:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8f86c8db3380) 00000020:00000080:3.0:1788652033.477406:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788652033.477496:0:17921:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788652033.477503:0:17921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c4e68 00000020:00000080:3.0:1788652033.477603:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788652033.477610:0:17921:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788652033.477614:0:17921:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xcd2f56ea038c4e6f 00080000:01000000:3.0:1788652033.477621:0:17921:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788652033.477624:0:17921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c4e76 00010000:00010000:1.0:1788652033.568303:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652033.629852:0:17921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:0.0:1788652033.630714:0:17921:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:0.0:1788652033.631476:0:17921:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788652033.636320:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1788652033.636334:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652033.636342:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652033.636345:0:17921:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1788652033.636348:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652033.636353:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652033.636355:0:17921:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1788652033.636357:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788652033.636362:0:17921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:00000080:0.0:1788652033.636390:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652033.636404:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8f86eeba99c0) 00000020:00000080:0.0:1788652033.636424:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1788652033.636429:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788652033.636542:0:17921:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1788652033.636550:0:17921:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788652033.636557:0:17921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c4e84 00010000:00080000:0.0:1788652033.636591:0:17921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f86c6d44800@lustre-MDT0000-osp-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:0.0:1788652033.638259:0:17921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788652033.640704:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788652033.640721:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788652033.640887:0:17921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788652033.640938:0:17921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c4e8b 00000100:00080000:0.0:1788652033.640950:0:17921:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788652033.640957:0:17921:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8f86c6d44800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652033.641141:0:17921:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d0e00 x1875537147641088/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788652033.641307:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147641088:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788652033.641489:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788652033.641558:0:17921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:0.0:1788652033.641616:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652033.641622:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652033.641624:0:17921:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:0.0:1788652033.641627:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788652033.641630:0:17921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1788652033.641631:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788652033.641633:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788652033.641635:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788652033.641637:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652033.641638:0:17921:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788652033.641640:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788652033.641644:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652033.641645:0:17921:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:0.0:1788652033.641649:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788652033.641686:0:17921:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788652033.641710:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652033.641713:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652033.641715:0:17921:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:0.0:1788652033.641717:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788652033.641719:0:17921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788652033.641720:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788652033.641721:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788652033.641723:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788652033.641725:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652033.641727:0:17921:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788652033.641729:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788652033.641733:0:17921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788652033.641735:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652033.641737:0:17921:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788652033.641739:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788652033.641742:0:17921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000100:00080000:3.0:1788652033.641883:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788652033.641889:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788652033.641892:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652033.641897:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 488 00000100:00080000:3.0:1788652033.641900:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788652033.641920:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f85c3fbc000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652033.641942:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff462300 x1875537147641216/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652033.641959:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652033.641962:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652033.641977:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652033.641980:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788652033.642016:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147641344:0@lo:400:kworker.0 00000100:00100000:3.0:1788652033.642066:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652033.642110:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147641344 00000100:00100000:3.0:1788652033.642116:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147641344 00000100:00100000:3.0:1788652033.642159:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652033.642167:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147641344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652033.642700:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147641344:12345-0@lo:400:kworker.0 Request processed in 76us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652033.642717:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788652033.642777:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f86ff460e00 x1875537147641344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652033.642791:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147641344:0@lo:400:kworker.0 00000100:00100000:3.0:1788652033.642820:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147641216:0@lo:38:kworker.0 00000100:00100000:3.0:1788652033.642848:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652033.642880:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147641088 00000100:00100000:3.0:1788652033.642884:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147641088 00000100:00100000:3.0:1788652033.642899:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147641216 00000100:00100000:3.0:1788652033.642901:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147641216 00000100:00100000:3.0:1788652033.642932:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652033.642938:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875537147641088:12345-0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788652033.643329:0:17921:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788652033.643335:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652033.643351:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8f86eebacd40) 00010000:00080000:3.0:1788652033.643420:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:3.0:1788652033.643469:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c4e92 00000004:00100000:3.0:1788652033.643483:0:17192:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788652033.643489:0:17192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000020:00000080:0.0:1788652033.645152:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788652033.645171:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788652033.646453:0:17921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788652033.646464:0:17921:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788652033.646474:0:17921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c4ea0 00010000:00080000:0.0:1788652033.646522:0:17921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f86c6e8f800@lustre-OST0000-osc-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:0.0:1788652033.646782:0:17921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1788652033.652667:0:17192:0:(import.c:65:import_set_state_nolock()) ffff8f85c210b000 : changing import state from RECOVER to FULL 00000040:01000000:0.0:1788652033.653192:0:17921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788652033.653489:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1875537147641088:12345-0@lo:38:llog_process_th.0 Request processed in 10547us (11996us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652033.653501:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652033.653533:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788652033.653540:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875537147641216:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1788652033.653587:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875537147641216:12345-0@lo:38:kworker.0 Request processed in 47us (10738us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788652033.653593:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652033.654501:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788652033.654511:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788652033.654516:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788652033.654519:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147641216:0@lo:38:kworker.0 00000100:00100000:2.0:1788652033.654538:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788652033.654554:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788652033.654563:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788652033.654570:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788652033.654572:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6d44800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788652033.654590:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147641088:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788652033.654885:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652033.654900:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147641472:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652033.654978:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:0.0:1788652033.655199:0:17921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788652033.655698:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147641472 00000100:00100000:0.0:1788652033.655707:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147641472 00000100:00100000:0.0:1788652033.655757:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788652033.655768:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875537147641472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788652033.655806:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788652033.655868:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3638:x1875537147641472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 101us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.655875:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652033.656655:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147641472:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788652033.663495:0:17921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652033.663820:0:17921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788652033.664546:0:17921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:1.0:1788652033.665603:0:17926:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788652033.665609:0:17926:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788652033.667625:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788652033.667640:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788652033.667685:0:17921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788652033.667707:0:17921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c4ea7 00000100:00080000:0.0:1788652033.667718:0:17921:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788652033.667724:0:17921:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f86c6e8f800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652033.667822:0:17921:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d3800 x1875537147641600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788652033.667891:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147641600:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788652033.668154:0:17921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000400:00000100:2.0:1788652033.668487:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147641600 offset 0 length 520: 4 00000100:00080000:3.0:1788652033.668632:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652033.668637:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652033.668639:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652033.668642:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:01000000:0.0:1788652033.668698:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788652033.668704:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652033.668706:0:17921:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788652033.668709:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788652033.668711:0:17921:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788652033.668713:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788652033.668714:0:17921:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788652033.668716:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788652033.668718:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652033.668719:0:17921:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788652033.668722:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788652033.668726:0:17921:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788652033.668729:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652033.668731:0:17921:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788652033.668734:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788652033.668738:0:17921:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.145@tcp to nid 0x20000c0a8cc91 (192.168.204.145@tcp) 00000020:01000000:0.0:1788652033.668828:0:17921:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788652033.668842:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652033.668856:0:17921:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8f86eebab380) 00000020:00000080:0.0:1788652033.668871:0:17921:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1788652033.668876:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788652033.671578:0:17921:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1788652033.671593:0:17921:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788652033.671605:0:17921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xcd2f56ea038c4eb5 00010000:00080000:0.0:1788652033.671645:0:17921:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f86c6e8e000@lustre-OST0001-osc-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:0.0:1788652033.671898:0:17921:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1788652033.671992:0:17921:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788652033.672007:0:17921:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1788652033.675835:0:17921:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652033.678103:0:17921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1788652033.678524:0:17921:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788652033.680944:0:17928:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788652033.680951:0:17928:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788652033.686673:0:17921:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788652033.686690:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788652033.686777:0:17921:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788652033.686800:0:17921:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c4ebc 00000100:00080000:2.0:1788652033.686811:0:17921:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652033.686817:0:17921:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f86c6e8e000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652033.686856:0:17921:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff446300 x1875537147641728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652033.686889:0:17921:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788652033.686982:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652033.686987:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652033.686989:0:17921:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788652033.686993:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652033.686996:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652033.686998:0:17921:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788652033.687002:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788652033.687009:0:17921:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788652033.687013:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652033.687016:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652033.687017:0:17921:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788652033.687019:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652033.687022:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652033.687024:0:17921:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788652033.687027:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788652033.687078:0:17921:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652033.687082:0:17921:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652033.687084:0:17921:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788652033.687087:0:17921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:1.0:1788652033.687211:0:17917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788652033.687247:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788652033.687282:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.687294:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f0906400/0xcd2f56ea038c4e3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4e45 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652033.687303:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f85c3548800 from 1 10000000:01000000:1.0:1788652033.687306:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788652033.687334:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.687343:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.687354:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652033.687385:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147641856:0@lo:101:mount.lustre.0 00000100:00080000:0.0:1788652033.687387:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652033.687394:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652033.687397:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652033.687399:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788652033.687473:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652033.687572:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f09680c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652033.687649:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147641728:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788652033.687681:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147641728 offset 0 length 520: 4 00000100:00100000:0.0:1788652033.694833:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147641856 00000100:00100000:0.0:1788652033.694860:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147641856 00000100:00100000:0.0:1788652033.694951:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788652033.694963:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+15:17917:x1875537147641856:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652033.694979:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652033.695000:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b97000/0xcd2f56ea038c4eca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4ec3 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.695048:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b97000/0xcd2f56ea038c4eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4ec3 expref: 16 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.695060:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b97000/0xcd2f56ea038c4eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4ec3 expref: 16 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.695069:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97000, rc 0) 00000100:00100000:0.0:1788652033.695150:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+16:17917:x1875537147641856:12345-0@lo:101:mount.lustre.0 Request processed in 189us (7676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.695168:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788652033.696823:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147641856:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652033.696847:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.696861:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652033.697671:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147641984:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788652033.697751:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652033.697865:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652033.706259:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147641984 00000100:00100000:3.0:1788652033.706276:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147641984 00000100:00100000:3.0:1788652033.706336:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788652033.706345:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+16:17917:x1875537147641984:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788652033.706381:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788652033.706405:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788652033.706409:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788652033.706566:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+16:17917:x1875537147641984:12345-0@lo:256:mount.lustre.0 Request processed in 221us (8813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652033.706574:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788652033.706739:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147641984:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788652033.707382:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788652033.707407:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.707419:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652033.707498:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f85c3548800 from 1 10000000:01000000:2.0:1788652033.707501:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652033.707534:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.707542:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.707552:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652033.707572:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788652033.707614:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652033.707655:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652033.707675:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147642112 00000100:00100000:1.0:1788652033.707682:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147642112 00000100:00100000:1.0:1788652033.707725:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788652033.707733:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+16:17917:x1875537147642112:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652033.707746:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652033.707759:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c4ed8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4ed1 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.707782:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c4ed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4ed1 expref: 17 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.707792:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c4ed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4ed1 expref: 17 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.707800:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9c00, rc 0) 00000100:00100000:1.0:1788652033.707857:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17917:x1875537147642112:12345-0@lo:101:mount.lustre.0 Request processed in 124us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.707864:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788652033.708414:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652033.708439:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652033.708450:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652033.708591:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652033.708625:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652033.708658:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652033.708695:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d12aff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652033.709014:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147642240 00000100:00100000:0.0:1788652033.709021:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147642240 00000100:00100000:0.0:1788652033.709060:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788652033.709068:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17917:x1875537147642240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652033.709178:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17917:x1875537147642240:12345-0@lo:501:mount.lustre.0 Request processed in 110us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.709185:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788652033.712527:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652033.712593:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652033.712668:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652033.712716:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d12aff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788652033.713020:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147642368 00000100:00100000:2.0:1788652033.713028:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147642368 00000100:00100000:2.0:1788652033.713081:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788652033.713089:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17917:x1875537147642368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652033.713223:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17917:x1875537147642368:12345-0@lo:503:mount.lustre.0 Request processed in 133us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652033.713231:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788652033.713769:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642368:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788652033.714219:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652033.714695:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642496:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652033.714767:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652033.714810:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d12af3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652033.714992:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147642496 00000100:00100000:1.0:1788652033.714999:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147642496 00000100:00100000:1.0:1788652033.715046:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788652033.715055:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17917:x1875537147642496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652033.715176:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17917:x1875537147642496:12345-0@lo:502:mount.lustre.0 Request processed in 121us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.715184:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788652033.715835:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642496:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652033.716231:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788652033.716328:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:3.0:1788652033.716344:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:3.0:1788652033.716548:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:3.0:1788652033.716574:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:3.0:1788652033.716588:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:3.0:1788652033.716602:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:3.0:1788652033.716617:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:3.0:1788652033.716633:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788652033.716649:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:3.0:1788652033.716686:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:3.0:1788652033.716728:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652033.724860:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652033.724995:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d12af3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652033.729864:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147642624 00000100:00100000:3.0:1788652033.729880:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147642624 00000100:00100000:2.0:1788652033.730046:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788652033.730058:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17917:x1875537147642624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652033.730244:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17917:x1875537147642624:12345-0@lo:502:mount.lustre.0 Request processed in 188us (5392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652033.730262:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788652033.730935:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788652033.731064:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:0.0:1788652033.731078:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788652033.734309:0:17930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652033.734326:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652033.734328:0:17930:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788652033.734340:0:17930:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f85c3548800 00000020:00000080:3.0:1788652033.734343:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652033.734486:0:17930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652033.734490:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652033.734492:0:17930:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788652033.734495:0:17930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652033.734498:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652033.734499:0:17930:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788652033.734504:0:17930:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f85c3548800 00000020:00000080:3.0:1788652033.734506:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652033.734592:0:17930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652033.734597:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652033.734598:0:17930:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788652033.734601:0:17930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652033.734603:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652033.734604:0:17930:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788652033.734607:0:17930:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f85c3548800 00000020:00000080:3.0:1788652033.734609:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652033.734626:0:17930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652033.734629:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652033.734630:0:17930:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788652033.734632:0:17930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652033.734634:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652033.734635:0:17930:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788652033.734639:0:17930:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f85c3548800 00000020:00000080:3.0:1788652033.734640:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652033.734662:0:17930:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652033.734680:0:17930:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652033.734681:0:17930:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788652033.734684:0:17930:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:1.0:1788652033.739487:0:17917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788652033.739535:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788652033.742872:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.742927:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652033.743003:0:17917:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788652033.743007:0:17917:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f85c3548800 10000000:01000000:1.0:1788652033.743010:0:17917:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f85c3548800 10000000:01000000:1.0:1788652033.743014:0:17917:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788652033.743021:0:17917:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f85c3548800 from 1 10000000:01000000:1.0:1788652033.743023:0:17917:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788652033.743072:0:17917:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.743081:0:17917:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.743092:0:17917:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652033.743117:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642752:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788652033.743187:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652033.743254:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147642752 00000100:00100000:1.0:1788652033.743260:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147642752 00000100:00100000:1.0:1788652033.743298:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788652033.743306:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17917:x1875537147642752:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652033.743317:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652033.743328:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c4ee6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4edf expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.743527:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c4ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4edf expref: 18 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.743540:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f9200/0xcd2f56ea038c4ee6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4edf expref: 18 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.743549:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9200, rc 0) 00000100:00100000:1.0:1788652033.743582:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147642752:12345-0@lo:101:mount.lustre.0 Request processed in 277us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.743589:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788652033.743635:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f09680c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652033.743659:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642752:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652033.743673:0:17917:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.743682:0:17917:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788652033.749184:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788652033.750713:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652033.750943:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788652033.756474:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:2.0:1788652033.756545:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:2.0:1788652033.756580:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:2.0:1788652033.756597:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:2.0:1788652033.756610:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:2.0:1788652033.756622:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:2.0:1788652033.756635:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:2.0:1788652033.756650:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:2.0:1788652033.756666:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:2.0:1788652033.756680:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:2.0:1788652033.756694:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:2.0:1788652033.756708:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:2.0:1788652033.756721:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:2.0:1788652033.756733:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:2.0:1788652033.756745:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:2.0:1788652033.756758:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:2.0:1788652033.756769:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:2.0:1788652033.756783:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:2.0:1788652033.756809:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:2.0:1788652033.756822:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:2.0:1788652033.756835:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:2.0:1788652033.756847:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:2.0:1788652033.756860:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:2.0:1788652033.756872:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:2.0:1788652033.756884:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:2.0:1788652033.756895:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:2.0:1788652033.756928:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:2.0:1788652033.756959:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:2.0:1788652033.756965:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788652033.757082:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652033.757159:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652033.757209:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788652033.758610:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147642880 00000100:00100000:1.0:1788652033.758622:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147642880 00000100:00100000:1.0:1788652033.758679:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788652033.758688:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147642880:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652033.758870:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147642880:12345-0@lo:501:mount.lustre.0 Request processed in 183us (1710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.758878:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788652033.759369:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147642880:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652033.759417:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147643008:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652033.759476:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652033.759510:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f49ef300 going to sleep for 11 seconds 00000100:00100000:1.0:1788652033.760073:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147643008 00000100:00100000:1.0:1788652033.760086:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147643008 00000100:00100000:1.0:1788652033.760127:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788652033.760135:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147643008:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652033.760248:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147643008:12345-0@lo:503:mount.lustre.0 Request processed in 103us (760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.760256:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788652033.760306:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147643008:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788652033.760775:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788652033.760855:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147643136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652033.760895:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652033.760961:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147643136 00000100:00100000:1.0:1788652033.762105:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147643136 00000100:00100000:1.0:1788652033.762165:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788652033.762173:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147643136:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652033.762562:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147643136:12345-0@lo:502:mount.lustre.0 Request processed in 388us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.762570:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788652033.762636:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788652033.762658:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147643136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788652033.765876:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788652033.765955:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:1.0:1788652033.766170:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:1.0:1788652033.766188:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:1.0:1788652033.766203:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:1.0:1788652033.766217:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:1.0:1788652033.766231:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:1.0:1788652033.766841:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:1.0:1788652033.766878:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:1.0:1788652033.766893:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:1.0:1788652033.767172:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:1.0:1788652033.767199:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:1.0:1788652033.767215:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:1.0:1788652033.767231:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:1.0:1788652033.767552:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:1.0:1788652033.767568:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:1.0:1788652033.767584:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:1.0:1788652033.767598:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:1.0:1788652033.767631:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:1.0:1788652033.767648:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:1.0:1788652033.767663:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:1.0:1788652033.767678:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:1.0:1788652033.767694:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:1.0:1788652033.767710:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:1.0:1788652033.767726:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:1.0:1788652033.769030:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:1.0:1788652033.769153:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:1.0:1788652033.769167:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:1.0:1788652033.769179:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:1.0:1788652033.769192:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:1.0:1788652033.769206:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:1.0:1788652033.769228:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:1.0:1788652033.769870:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:1.0:1788652033.769895:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:1.0:1788652033.769954:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:1.0:1788652033.770455:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:1.0:1788652033.770472:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:1.0:1788652033.770485:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:1.0:1788652033.770496:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:1.0:1788652033.770508:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:1.0:1788652033.770520:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:1.0:1788652033.770540:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:1.0:1788652033.770552:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:1.0:1788652033.770565:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:1.0:1788652033.770577:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:1.0:1788652033.770589:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:1.0:1788652033.770600:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:1.0:1788652033.770613:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:1.0:1788652033.772093:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147643264:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652033.772178:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652033.772236:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f180 going to sleep for 11 seconds 00000100:00100000:3.0:1788652033.773440:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147643264 00000100:00100000:3.0:1788652033.773449:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147643264 00000100:00100000:3.0:1788652033.773508:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788652033.773518:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147643264:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652033.773667:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147643264:12345-0@lo:502:mount.lustre.0 Request processed in 149us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652033.773674:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788652033.774470:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147643264:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788652033.774686:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:1.0:1788652033.774723:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:1.0:1788652033.774771:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147643392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652033.776719:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652033.776773:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147643392 00000100:00100000:1.0:1788652033.776781:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147643392 00000100:00100000:1.0:1788652033.776835:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788652033.776845:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147643392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652033.778995:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045f180 going to sleep for 11 seconds 00000100:00100000:1.0:1788652033.780484:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147643392:12345-0@lo:502:mount.lustre.0 Request processed in 3632us (3762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.780499:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788652033.781092:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147643392:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652033.781224:0:17917:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:3.0:1788652033.782127:0:17917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788652033.792055:0:17935:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788652033.792072:0:17935:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8f86c8db4d40) 00000020:00000080:3.0:1788652033.792093:0:17935:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788652033.792185:0:17935:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f85c3548800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788652033.792189:0:17935:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f85c3548800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788652033.792191:0:17935:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f85c3548800 3 00010000:00080000:3.0:1788652033.792219:0:17935:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c2add000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.204.145@tcp at head 00010000:00010000:3.0:1788652033.803220:0:17935:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788652033.803736:0:17935:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788652033.803779:0:17935:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788652033.803791:0:17935:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xcd2f56ea038c4ef4 00000100:00080000:3.0:1788652033.803802:0:17935:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652033.803808:0:17935:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8f85c2add000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652033.803841:0:17935:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff460700 x1875537147643520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652033.803872:0:17935:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788652033.810150:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147643520:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788652033.810814:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652033.811348:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147643520 00000100:00100000:0.0:1788652033.811371:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147643520 00000100:00100000:0.0:1788652033.811416:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788652033.811425:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3634:x1875537147643520:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788652033.811489:0:17187:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:0.0:1788652033.811533:0:17187:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xcd2f56ea038c4efb 00000004:00100000:0.0:1788652033.811550:0:17187:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788652033.811583:0:17187:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652033.811651:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3634:x1875537147643520:12345-0@lo:38:llog_process_th.0 Request processed in 226us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.811658:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788652033.812629:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652033.812636:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652033.812638:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652033.812641:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788652033.812878:0:17935:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00010000:00080000:2.0:1788652033.813182:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f86ff460700 x1875537147643520/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652043 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652033.813194:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788652033.813203:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788652033.813211:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788652033.813225:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788652033.813228:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c2add000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788652033.813235:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3634:1875537147643520:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1788652033.814141:0:17917:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788652033.814177:0:17917:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788652033.814199:0:17917:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.814210:0:17917:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f9400/0xcd2f56ea038c4edf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4ee6 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788652033.814275:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788652033.814277:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788652033.814279:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652033.814280:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652033.814281:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652033.814283:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652033.814284:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788652033.814286:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652033.814287:0:17917:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652033.814295:0:17917:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1788652033.814297:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788652033.814298:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788652033.814300:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652033.814301:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652033.814302:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652033.814303:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652033.814303:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788652033.814304:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652033.814305:0:17917:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652033.814328:0:17917:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788652033.814363:0:17917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147643648:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788652033.814441:0:17917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652033.814481:0:17917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc550c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652033.814782:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147643648 00000100:00100000:3.0:1788652033.814790:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147643648 00000100:00100000:3.0:1788652033.814849:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788652033.814859:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17917:x1875537147643648:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788652033.814889:0:17182:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788652033.814904:0:17182:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:1.0:1788652033.829953:0:17167:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1788652033.831169:0:17182:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788652033.831183:0:17182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:1.0:1788652033.832054:0:17202:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788652033.832061:0:17202:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788652033.832083:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.832113:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4e06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4dff expref: 18 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.832121:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86f4b97000/0xcd2f56ea038c4eca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4ec3 expref: 18 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.832128:0:17202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.832169:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86f4b97000/0xcd2f56ea038c4eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4ec3 expref: 18 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.832182:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86f4b97000/0xcd2f56ea038c4eca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4ec3 expref: 18 pid: 17182 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652033.832197:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147643776:0@lo:104: 00000100:00100000:1.0:1788652033.833939:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788652033.834137:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4dff expref: 18 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.834151:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4e06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dff expref: 18 pid: 17181 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652033.834164:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147643904:0@lo:104: 00000100:00100000:1.0:1788652033.834192:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652033.834219:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d045fa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652033.834397:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147643776 00000100:00100000:0.0:1788652033.834405:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147643776 00000100:00100000:0.0:1788652033.834455:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147643904 00000100:00100000:0.0:1788652033.834458:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147643904 00000100:00100000:0.0:1788652033.834473:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652033.834481:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+4:17202:x1875537147643776:12345-0@lo:104: 00010000:00010000:0.0:1788652033.834495:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834555:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788652033.834562:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+4:17202:x1875537147643776:12345-0@lo:104: Request processed in 81us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.834569:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652033.834588:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788652033.834594:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:17202:x1875537147643904:12345-0@lo:104: 00010000:00010000:0.0:1788652033.834602:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834661:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788652033.834666:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:17202:x1875537147643904:12345-0@lo:104: Request processed in 73us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.834672:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788652033.834689:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652033.834695:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834702:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652033.834707:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834716:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652033.834724:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652033.834730:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788652033.834773:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834780:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652033.834799:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834806:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9800/0xcd2f56ea038c4ec3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4eca expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834831:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652033.834835:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834841:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f8600 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:0.0:1788652033.834843:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834851:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788652033.834857:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652033.834863:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788652033.834877:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834884:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788652033.834895:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834902:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f8600/0xcd2f56ea038c4dff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4e06 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.834947:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652033.834949:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652033.834951:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652033.834983:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147644032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652033.835021:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652033.835475:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147643776:0@lo:104: 00000100:00100000:1.0:1788652033.835484:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147643904:0@lo:104: 00010000:00010000:1.0:1788652033.835513:0:17202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.835530:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652033.835542:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147644032 00000100:00100000:1.0:1788652033.835546:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147644032 00010000:00010000:1.0:1788652033.835566:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86f4b97000/0xcd2f56ea038c4eca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4ec3 expref: 19 pid: 17182 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652033.835600:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652033.835607:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:3638:x1875537147644032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652033.835620:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652033.835638:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86f4b97000/0xcd2f56ea038c4eca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4ec3 expref: 19 pid: 17182 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.835649:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86f4b97000/0xcd2f56ea038c4eca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4ec3 expref: 19 pid: 17182 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.835664:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b97000/0xcd2f56ea038c4eca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4ec3 expref: 19 pid: 17182 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652033.835677:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652033.835713:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:3638:x1875537147644032:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.835721:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652033.835747:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147644032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652033.835805:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17917:x1875537147643648:12345-0@lo:253:mount.lustre.0 Request processed in 20947us (21363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.835814:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788652033.835878:0:17917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:17917:1875537147643648:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788652033.835889:0:17917:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788652033.835892:0:17917:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788652033.835894:0:17917:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788652033.835895:0:17917:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652033.835897:0:17917:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652033.835898:0:17917:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652033.835899:0:17917:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652033.835900:0:17917:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788652033.835901:0:17917:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652033.835903:0:17917:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788652033.835937:0:17917:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788652033.840000:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147644160:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652033.840078:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652033.842963:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147644160 00000100:00100000:2.0:1788652033.842978:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147644160 00010000:00010000:2.0:1788652033.843019:0:17174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4e06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dff expref: 17 pid: 17181 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652033.843077:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652033.843087:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:3635:x1875537147644160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652033.843100:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652033.843106:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4e06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dff expref: 17 pid: 17181 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.843460:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4e06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dff expref: 17 pid: 17181 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.843479:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4e06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4dff expref: 17 pid: 17181 timeout: 589 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.843495:0:17174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.843504:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788652033.843521:0:17174:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011767327s 00010000:00010000:2.0:1788652033.843526:0:17174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.843532:0:17174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.843538:0:17174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.843544:0:17174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.843551:0:17174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f8000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652033.843555:0:17174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.843562:0:17174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.843593:0:17174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652033.843604:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652033.843689:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a28e2822-101e-46fe-b9c1-7a60e90536a9+16:3635:x1875537147644160:12345-0@lo:103:ldlm_bl.0 Request processed in 603us (3610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652033.843696:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788652033.843845:0:17202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.843855:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652033.843862:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f02 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652033.844497:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147644160:0@lo:103:ldlm_bl.0 00000040:01000000:2.0:1788652033.860624:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788652033.860830:0:17940:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788652033.860834:0:17940:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788652033.868004:0:17942:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788652033.868368:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:2.0:1788652033.869758:0:17942:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788652033.870595:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17943:1875537147644288:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788652033.870666:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652033.870695:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d03a6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652033.870960:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147644288 00000100:00100000:1.0:1788652033.870967:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147644288 00000100:00100000:1.0:1788652033.871017:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788652033.871026:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17943:x1875537147644288:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788652033.871118:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17943:x1875537147644288:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 93us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.871125:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788652033.871163:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17943:1875537147644288:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788652033.871193:0:17943:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788652033.871218:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17943:1875537147644416:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788652033.871247:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652033.871264:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147644416 00000100:00100000:1.0:1788652033.871267:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147644416 00000100:00100000:1.0:1788652033.871291:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652033.871296:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17943:x1875537147644416:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788652033.871395:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17943:x1875537147644416:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 97us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652033.871401:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788652033.871415:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d03a6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652033.871438:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17943:1875537147644416:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788652033.871484:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17943:1875537147644544:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788652033.871510:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652033.871532:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d03a6cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652033.872483:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147644544 00000100:00100000:0.0:1788652033.872492:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147644544 00000100:00100000:0.0:1788652033.872534:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652033.872542:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17943:x1875537147644544:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788652033.872609:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17943:x1875537147644544:12345-0@lo:900:lod0001_rec0000.0 Request processed in 69us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.872616:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788652033.872761:0:17943:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8f85c3458e00 x1875537147644544/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788652049 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652033.872772:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17943:1875537147644544:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788652033.872826:0:17943:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17943:1875537147644672:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788652033.872869:0:17943:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652033.872890:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147644672 00000100:00100000:0.0:1788652033.872893:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147644672 00000100:00100000:0.0:1788652033.872924:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652033.872930:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17943:x1875537147644672:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788652033.872972:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17943:x1875537147644672:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 42us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652033.872984:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652033.872998:0:17943:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc55e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788652033.873009:0:17943:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17943:1875537147644672:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788652033.873044:0:17943:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788652033.876116:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788652033.876166:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788652033.877466:0:17942:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788652033.877544:0:17942:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00000080:3.0:1788652033.879050:0:17917:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788652033.879073:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788652033.879172:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652033.881827:0:17943:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788652033.882008:0:17943:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788652033.882015:0:17943:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:3.0:1788652033.882501:0:17917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788652033.883548:0:17917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788652033.883592:0:17917:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788652033.883739:0:17917:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788652033.884563:0:17917:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000001:00000004:3.0:1788652033.886724:0:17917:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788652033.914155:0:17917:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788652033.914265:0:17917:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa71c01acb988 00100000:10000000:1.0:1788652033.914274:0:17917:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788652033.916113:0:17917:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788652033.916148:0:17917:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788652033.916168:0:17917:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788652033.916203:0:17917:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788652033.919060:0:17917:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788652033.920976:0:17917:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788652034.336030:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652034.592104:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788652034.914021:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788652035.361973:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:1.0:1788652035.620338:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788652035.679989:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788652035.679997:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f85c3548800 from 8 10000000:01000000:1.0:1788652035.680001:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788652035.680045:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652035.680057:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652035.680068:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652035.680100:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147644800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788652035.680182:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652035.680242:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d03a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652035.681517:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147644800 00000100:00100000:0.0:1788652035.681529:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147644800 00000100:00100000:0.0:1788652035.681593:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788652035.681602:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+16:17184:x1875537147644800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652035.681617:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652035.681633:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b97a00/0xcd2f56ea038c4f10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4f09 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652035.681657:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b97a00/0xcd2f56ea038c4f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f09 expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652035.681669:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b97a00/0xcd2f56ea038c4f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f09 expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652035.681678:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97a00, rc 0) 00000100:00100000:0.0:1788652035.681736:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17184:x1875537147644800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652035.681744:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788652035.681843:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147644800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652035.681859:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652035.681869:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652035.681960:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147644928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788652035.681995:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652035.682023:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d03a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652035.682725:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147644928 00000100:00100000:0.0:1788652035.682743:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147644928 00000100:00100000:0.0:1788652035.682787:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788652035.682795:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17184:x1875537147644928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788652035.682822:0:17182:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788652035.682840:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788652035.682843:0:17182:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1788652035.682966:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17184:x1875537147644928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 172us (969us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652035.682974:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788652035.683064:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147644928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788652035.683112:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788652035.683132:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652035.683141:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652035.683151:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788652035.683153:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86c3255800 from 8 10000000:01000000:1.0:1788652035.683156:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788652035.683182:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652035.683198:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652035.683218:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652035.683234:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147645056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788652035.683264:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652035.683295:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d03a6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652035.683310:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147645056 00000100:00100000:1.0:1788652035.683314:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147645056 00000100:00100000:1.0:1788652035.683341:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788652035.683347:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17184:x1875537147645056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652035.683355:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652035.683366:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4f17 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652035.683382:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f17 expref: 18 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652035.683390:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f17 expref: 18 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652035.683408:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f8000, rc 0) 00000100:00100000:1.0:1788652035.683437:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17184:x1875537147645056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652035.683444:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788652035.683483:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147645056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652035.683493:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652035.683501:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652035.683539:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147645184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788652035.683567:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652035.683579:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d03a6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652035.683591:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147645184 00000100:00100000:1.0:1788652035.683594:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147645184 00000100:00100000:1.0:1788652035.683615:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788652035.683622:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17184:x1875537147645184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788652035.683632:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788652035.683644:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788652035.683646:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1788652035.683709:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17184:x1875537147645184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 87us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652035.683717:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788652035.683747:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147645184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788652035.683777:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788652035.683782:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652035.683790:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652035.945793:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788652036.388438:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652036.640105:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652037.407991:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:1.0:1788652037.667131:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652038.439426:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 0 seconds 00010000:00010000:0.0:1788652038.692765:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788652039.136260:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788652039.136267:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788652039.136271:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652039.136287:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8f85c3fbc000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652039.136314:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c345b100 x1875537147645440/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652039.136343:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652039.136347:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652039.136350:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652039.136354:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652039.136382:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652039.136385:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652039.136387:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652039.136390:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788652039.136422:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147645824:0@lo:400:kworker.0 00000100:00100000:1.0:1788652039.136502:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652039.136570:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652039.136576:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147645312:0@lo:400:kworker.0 00000100:00100000:1.0:1788652039.136606:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652039.136640:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147645440:0@lo:38:kworker.0 00000100:00100000:1.0:1788652039.136686:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652039.136720:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147645568:0@lo:400:kworker.0 00000100:00100000:1.0:1788652039.136756:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652039.136776:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652039.136782:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147645696:0@lo:400:kworker.0 00000100:00100000:1.0:1788652039.136804:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652039.136835:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147645824 00000100:00100000:1.0:1788652039.136842:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147645824 00000100:00100000:1.0:1788652039.136881:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147645568 00000100:00100000:1.0:1788652039.136885:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147645568 00000100:00100000:1.0:1788652039.136899:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652039.136931:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147645824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652039.136983:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147645824:12345-0@lo:400:kworker.0 Request processed in 76us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652039.136989:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652039.137005:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652039.137011:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147645568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652039.137039:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147645568:12345-0@lo:400:kworker.0 Request processed in 29us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652039.137045:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788652039.139227:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147645440 00000100:00100000:0.0:1788652039.139243:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147645440 00000100:00100000:0.0:1788652039.139277:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147645696 00000100:00100000:0.0:1788652039.139279:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147645696 00000100:00100000:0.0:1788652039.139307:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788652039.139316:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3634:x1875537147645440:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788652039.139363:0:17192:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:0.0:1788652039.139400:0:17192:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c4f25 00000004:00100000:0.0:1788652039.139418:0:17192:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788652039.139425:0:17192:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:0.0:1788652039.139509:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147645312 00000100:00100000:0.0:1788652039.139514:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147645312 00000100:00100000:0.0:1788652039.139543:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788652039.139549:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:3635:x1875537147645312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652039.139626:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:3635:x1875537147645312:12345-0@lo:400:kworker.0 Request processed in 77us (3019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652039.139647:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1788652039.139797:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f85c345ad80 x1875537147645568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652039.139812:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147645568:0@lo:400:kworker.0 00000100:00100000:1.0:1788652039.139844:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147645312:0@lo:400:kworker.0 00010000:00080000:1.0:1788652039.139857:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f85c345a680 x1875537147645824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652039.139874:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147645824:0@lo:400:kworker.0 00000100:00100000:2.0:1788652039.146344:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652039.146368:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147645952:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788652039.146442:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652039.146548:0:17191:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:3.0:1788652039.146558:0:17191:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788652039.149461:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147645952 00000100:00100000:2.0:1788652039.149479:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147645952 00000100:00100000:3.0:1788652039.149758:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652039.149771:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1875537147645696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652039.149886:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1875537147645696:12345-0@lo:400:kworker.0 Request processed in 118us (13079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652039.149894:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652039.149953:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652039.149960:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147645952:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788652039.149991:0:18173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788652039.150037:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147645952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (3594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652039.150044:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788652039.150171:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147645696:0@lo:400:kworker.0 00000100:00100000:2.0:1788652039.151253:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147645952:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788652039.170285:0:17192:0:(import.c:65:import_set_state_nolock()) ffff8f85c19f1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652039.170408:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1875537147645440:12345-0@lo:38:kworker.0 Request processed in 31091us (33719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652039.170420:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788652039.172972:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788652039.173016:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788652039.173026:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788652039.173030:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3fbc000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788652039.173063:0:3634:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000d6521784): req@ffff8f86ff445c00 x1875537147638144/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652039.173086:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147645440:0@lo:38:kworker.0 00000100:00100000:1.0:1788652039.174338:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652039.174364:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147646080:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652039.174473:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652039.176006:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147646080 00000100:00100000:2.0:1788652039.176020:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147646080 00000100:00100000:2.0:1788652039.176114:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652039.176124:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875537147646080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788652039.176168:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788652039.176264:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3638:x1875537147646080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 142us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652039.176277:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652039.176360:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147646080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788652039.181973:0:17226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652039.182054:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db300 going to sleep for 11 seconds 00000100:00100000:3.0:1788652039.182732:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147638144 00000100:00100000:3.0:1788652039.182865:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147638144 00000100:00100000:3.0:1788652039.182941:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788652039.182951:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17226:x1875537147638144:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788652039.183086:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17226:x1875537147638144:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 136us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652039.183094:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788652039.183143:0:17226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17226:1875537147638144:0@lo:1000:lod0000_rec0001.0 00000040:01000000:3.0:1788652039.183185:0:17226:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:3.0:1788652039.183239:0:17226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17226:1875537147646208:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788652039.183280:0:17226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652039.183307:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ff0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652039.183322:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147646208 00000100:00100000:3.0:1788652039.183336:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147646208 00000100:00100000:3.0:1788652039.188984:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788652039.189012:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17226:x1875537147646208:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788652039.189272:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17226:x1875537147646208:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 268us (5990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652039.189282:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788652039.190260:0:17226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461f80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17226:1875537147646208:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788652039.190388:0:17226:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17226:1875537147646336:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788652039.190451:0:17226:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652039.190487:0:17226:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0968480 going to sleep for 11 seconds 00000100:00100000:3.0:1788652039.190586:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147646336 00000100:00100000:3.0:1788652039.190595:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147646336 00000100:00100000:3.0:1788652039.190659:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788652039.190669:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17226:x1875537147646336:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1788652039.190758:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17226:x1875537147646336:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 91us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652039.190766:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788652039.190959:0:17226:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446680 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17226:1875537147646336:0@lo:1000:lod0000_rec0001.0 00000040:00080000:0.0:1788652039.191014:0:17226:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652039.198277:0:17226:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788652039.198379:0:17226:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 22, retries 0 00000004:00080000:0.0:1788652039.198385:0:17226:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:0.0:1788652039.318784:0:18187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:0.0:1788652039.393468:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788652039.712112:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788652040.318195:0:18239:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788652040.318782:0:18239:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788652040.736279:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788652041.467539:0:18290:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788652041.467788:0:18290:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788652041.761025:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652042.209178:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652027/real 1788652027] req@ffff8f86f48d1f80 x1875537147639168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652042.209218:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86f48d1f80 x1875537147639168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652042.209230:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652027/real 1788652027] req@ffff8f86f48d3480 x1875537147639296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652042 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652042.209242:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86f48d3480 x1875537147639296/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652042 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788652042.209262:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788652042.209296:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788652042.209301:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147639168:0@lo:8:kworker.0 00000100:00080000:2.0:1788652042.209307:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788652042.209313:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788652042.209316:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147639296:0@lo:8:kworker.0 00000100:00080000:0.0:1788652042.209577:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652042.209591:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788652042.209594:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652042.209599:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:0.0:1788652042.209605:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788652042.209612:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f86f67f3000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652042.209633:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d2300 x1875537147646720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788652042.209667:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652042.209670:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788652042.209672:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652042.209676:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 483 00000100:00080000:0.0:1788652042.209678:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788652042.209682:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f85c373a800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652042.209697:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d3480 x1875537147646848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788652042.209716:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652042.209719:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652042.209722:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652042.209725:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788652042.209752:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147646976:0@lo:400:kworker.0 00000100:00100000:0.0:1788652042.209830:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652042.209870:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788652042.209878:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147646592:0@lo:400:kworker.0 00000100:00100000:0.0:1788652042.209905:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652042.209978:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147646976 00000100:00100000:0.0:1788652042.209989:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147646976 00000100:00100000:0.0:1788652042.210038:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788652042.210048:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147646976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652042.210234:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147646976:12345-0@lo:400:kworker.0 Request processed in 187us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652042.210252:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788652042.210291:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147646592 00000100:00100000:0.0:1788652042.210296:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147646592 00000100:00100000:0.0:1788652042.210321:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652042.210328:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1875537147646592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652042.210365:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3636:x1875537147646592:12345-0@lo:400:kworker.0 Request processed in 38us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652042.210371:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652042.210390:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147646720:0@lo:8:kworker.0 00000400:00000100:0.0:1788652042.210409:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147646720 offset 0 length 520: 4 00000100:00100000:0.0:1788652042.210427:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147646848:0@lo:8:kworker.0 00000400:00000100:0.0:1788652042.210440:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147646848 offset 0 length 520: 4 00000100:00100000:0.0:1788652042.210472:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147646592:0@lo:400:kworker.0 00010000:00080000:0.0:1788652042.210484:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86f48d1f80 x1875537147646976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652042.210493:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147646976:0@lo:400:kworker.0 00000100:00100000:1.0:1788652042.210714:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147646464:0@lo:400:kworker.0 00000100:00100000:1.0:1788652042.210753:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652042.210778:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147647232:0@lo:400:kworker.0 00000100:00100000:1.0:1788652042.210802:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652042.210830:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652042.210837:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147647104:0@lo:400:kworker.0 00000100:00100000:1.0:1788652042.210861:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652042.210948:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147646464 00000100:00100000:0.0:1788652042.210953:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147646464 00000100:00100000:0.0:1788652042.210991:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788652042.210998:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:3638:x1875537147646464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652042.211037:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:3638:x1875537147646464:12345-0@lo:400:kworker.0 Request processed in 40us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652042.211043:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788652042.211075:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147646464:0@lo:400:kworker.0 00000100:00100000:2.0:1788652042.211182:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147647232 00000100:00100000:2.0:1788652042.211193:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147647232 00000100:00100000:2.0:1788652042.211222:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652042.211228:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147647232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652042.211263:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147647232:12345-0@lo:400:kworker.0 Request processed in 35us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652042.211290:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652042.211310:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147647104 00000100:00100000:2.0:1788652042.211314:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147647104 00000100:00100000:2.0:1788652042.211336:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788652042.211344:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147647104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652042.211372:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147647104:12345-0@lo:400:kworker.0 Request processed in 31us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652042.211378:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788652042.211535:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86f48d2a00 x1875537147647232/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652058 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652042.211545:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147647232:0@lo:400:kworker.0 00000100:00100000:0.0:1788652042.211563:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147647104:0@lo:400:kworker.0 00010000:00010000:2.0:1788652042.786779:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788652042.961462:0:18339:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc6a7cea0 20000000:00000080:1.0:1788652042.961482:0:18339:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f86c354dc00 uarg=0000000000000000 20000000:01000000:1.0:1788652042.961528:0:18339:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788652042.961535:0:18339:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788652042.961539:0:18339:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788652042.962501:0:18340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:1.0:1788652042.962832:0:18339:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788652042.971550:0:18339:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788652042.974781:0:18339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652042.974812:0:18339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4dd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4dce expref: 17 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652042.974820:0:18339:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c4ed8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4ed1 expref: 17 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652042.974826:0:18339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652042.974873:0:18339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c4ed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4ed1 expref: 17 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652042.974889:0:18339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c4ed8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4ed1 expref: 17 pid: 17181 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652042.974999:0:18339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18339:1875537147647360:0@lo:104: 00000100:00100000:0.0:1788652042.975209:0:18339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652042.975323:0:18339:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4dce expref: 17 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652042.975331:0:18339:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dce expref: 17 pid: 17181 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652042.975354:0:18339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18339:1875537147647488:0@lo:104: 00000100:00100000:0.0:1788652042.975382:0:18339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652042.976795:0:18339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d9968e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652042.976992:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147647360 00000100:00100000:1.0:1788652042.977004:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147647360 00000100:00100000:1.0:1788652042.977062:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147647488 00000100:00100000:1.0:1788652042.977076:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147647488 00000100:00100000:1.0:1788652042.977098:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652042.977109:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+4:18339:x1875537147647360:12345-0@lo:104: 00010000:00010000:1.0:1788652042.977129:0:17171:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652042.977308:0:17171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788652042.977315:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+4:18339:x1875537147647360:12345-0@lo:104: Request processed in 209us (2107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652042.977322:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788652042.977339:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788652042.977346:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:18339:x1875537147647488:12345-0@lo:104: 00010000:00010000:1.0:1788652042.977353:0:17171:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652042.977382:0:17171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788652042.977388:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:18339:x1875537147647488:12345-0@lo:104: Request processed in 43us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652042.977393:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788652042.977751:0:18339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18339:1875537147647360:0@lo:104: 00000100:00100000:0.0:1788652042.977762:0:18339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18339:1875537147647488:0@lo:104: 00010000:00010000:0.0:1788652042.977799:0:18339:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.977951:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652042.977961:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.977970:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788652042.977975:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.977986:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652042.977994:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652042.978000:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788652042.978061:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978078:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652042.978110:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978118:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6c00/0xcd2f56ea038c4ed1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4ed8 expref: -99 pid: 17917 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978131:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652042.978143:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978149:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788652042.978152:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978158:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652042.978164:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652042.978169:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788652042.978185:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978191:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652042.978196:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978211:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7c00/0xcd2f56ea038c4dce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4dd5 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978225:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652042.978227:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652042.978229:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652042.978235:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652042.978261:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147647744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652042.978316:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652042.978364:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788652042.978370:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147647616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652042.978391:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652042.978418:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147647744 00000100:00100000:2.0:1788652042.978425:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147647744 00010000:00010000:2.0:1788652042.978467:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dce expref: 18 pid: 17181 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652042.978492:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147647616 00000100:00100000:2.0:1788652042.978495:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147647616 00010000:00010000:2.0:1788652042.978507:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c4ed8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4ed1 expref: 19 pid: 17181 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652042.978520:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652042.978526:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:3636:x1875537147647744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652042.978538:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652042.978543:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4dd5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dce expref: 19 pid: 17181 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978575:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4dd5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4dce expref: 19 pid: 17181 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978591:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4dd5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4dce expref: 19 pid: 17181 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978604:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652042.978635:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:3636:x1875537147647744:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652042.978641:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652042.978656:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788652042.978662:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:3636:x1875537147647616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652042.978670:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652042.978674:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c4ed8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4ed1 expref: 17 pid: 17181 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978683:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c4ed8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4ed1 expref: 17 pid: 17181 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978692:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f9c00/0xcd2f56ea038c4ed8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4ed1 expref: 17 pid: 17181 timeout: 598 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978704:0:17172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978713:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978729:0:17172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978744:0:17172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978752:0:17172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978759:0:17172:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978765:0:17172:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652042.978769:0:17172:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978777:0:17172:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978788:0:17172:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652042.978798:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652042.978820:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+16:3636:x1875537147647616:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652042.978826:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788652042.978862:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147647616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652042.978871:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147647744:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788652042.979813:0:18339:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652042.979826:0:18339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652042.979832:0:18339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b97400/0xcd2f56ea038c4f2c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652043.232181:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652033/real 1788652033] req@ffff8f86ff446300 x1875537147641728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652043 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652043.232212:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86ff446300 x1875537147641728/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652043 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652043.232223:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652033/real 1788652033] req@ffff8f86f48d3800 x1875537147641600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652043 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652043.232236:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86f48d3800 x1875537147641600/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652043 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788652043.232295:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652043.232318:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788652043.232323:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147641728:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788652043.232329:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652043.232334:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788652043.232337:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147641600:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788652043.232551:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652043.232555:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652043.232558:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652043.232571:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652043.232612:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652043.232615:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788652043.232618:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652043.232623:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:1.0:1788652043.232629:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788652043.232635:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f86c6e8f800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652043.232656:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c368f800 x1875537147648384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652043.232668:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652043.232670:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788652043.232672:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652043.232675:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 489 00000100:00080000:1.0:1788652043.232678:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788652043.232681:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f86c6e8e000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652043.232689:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c368d880 x1875537147648512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652043.232719:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147648256:0@lo:400:kworker.0 00000100:00100000:1.0:1788652043.232785:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652043.232819:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788652043.232824:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147648128:0@lo:400:kworker.0 00000100:00100000:1.0:1788652043.232847:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652043.232874:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147648256 00000100:00100000:1.0:1788652043.232882:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147648256 00000100:00100000:1.0:1788652043.232954:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788652043.232964:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147648256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652043.233024:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147648256:12345-0@lo:400:kworker.0 Request processed in 61us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652043.233032:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788652043.233083:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147648256:0@lo:400:kworker.0 00000100:00100000:2.0:1788652043.233290:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147647872:0@lo:400:kworker.0 00000100:00100000:2.0:1788652043.233328:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652043.233362:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147648640:0@lo:400:kworker.0 00000100:00100000:2.0:1788652043.233387:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652043.233404:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652043.233409:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147648000:0@lo:400:kworker.0 00000100:00100000:2.0:1788652043.233428:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652043.233469:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147648128 00000100:00100000:2.0:1788652043.233473:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147648128 00000100:00100000:2.0:1788652043.233502:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147648640 00000100:00100000:2.0:1788652043.233505:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147648640 00000100:00100000:2.0:1788652043.233519:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652043.233525:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147648128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652043.233573:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147648128:12345-0@lo:400:kworker.0 Request processed in 48us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652043.233579:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652043.233591:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788652043.233596:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147648640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652043.233625:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147648640:12345-0@lo:400:kworker.0 Request processed in 29us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652043.233631:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788652043.233659:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f85c368f480 x1875537147648640/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652043.233669:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147648640:0@lo:400:kworker.0 00000100:00100000:2.0:1788652043.233702:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147648000 00000100:00100000:2.0:1788652043.233705:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147648000 00000100:00100000:2.0:1788652043.233726:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652043.233732:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875537147648000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652043.233776:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3637:x1875537147648000:12345-0@lo:400:kworker.0 Request processed in 44us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652043.233783:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652043.233805:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147648000:0@lo:400:kworker.0 00000100:00100000:0.0:1788652043.234090:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147648384:0@lo:8:kworker.0 00000400:00000100:0.0:1788652043.234124:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147648384 offset 0 length 520: 4 00000100:00100000:0.0:1788652043.234145:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147648512:0@lo:8:kworker.0 00000400:00000100:0.0:1788652043.234162:0:3634:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875537147648512 offset 0 length 520: 4 00000100:00100000:1.0:1788652043.234312:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147647872 00000100:00100000:1.0:1788652043.234318:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147647872 00000100:00100000:1.0:1788652043.234355:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788652043.234363:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+16:3637:x1875537147647872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652043.234424:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+16:3637:x1875537147647872:12345-0@lo:400:kworker.0 Request processed in 53us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652043.234431:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:1.0:1788652043.234474:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f85c345b100 x1875537147648128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652043.234485:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c345b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147648128:0@lo:400:kworker.0 00000100:00100000:2.0:1788652043.234597:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3459180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147647872:0@lo:400:kworker.0 00010000:00010000:2.0:1788652043.808948:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788652044.127970:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788652044.127978:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f85c3548800 from 13 10000000:01000000:1.0:1788652044.127982:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788652044.128040:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652044.128052:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652044.128064:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652044.128092:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147648768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788652044.128187:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652044.128249:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bd9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652044.128409:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147648768 00000100:00100000:3.0:1788652044.128419:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147648768 00000100:00100000:3.0:1788652044.128476:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788652044.128485:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+16:17184:x1875537147648768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652044.128498:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652044.128513:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f0906c00/0xcd2f56ea038c4f3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4f33 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652044.128541:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f0906c00/0xcd2f56ea038c4f3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f33 expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652044.128552:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f0906c00/0xcd2f56ea038c4f3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f33 expref: 17 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652044.128562:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906c00, rc 0) 00000100:00100000:3.0:1788652044.128615:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17184:x1875537147648768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652044.128622:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788652044.129439:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147648768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652044.129463:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652044.129477:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652044.130923:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147648896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652044.130992:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652044.131037:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bd9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652044.131427:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147648896 00000100:00100000:0.0:1788652044.131436:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147648896 00000100:00100000:0.0:1788652044.131489:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788652044.131498:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17184:x1875537147648896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652044.131807:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17184:x1875537147648896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652044.131816:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788652044.132065:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147648896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652044.132133:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147649024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652044.132188:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652044.132307:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bd9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652044.132448:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147649024 00000100:00100000:0.0:1788652044.132455:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147649024 00000100:00100000:0.0:1788652044.132491:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788652044.132511:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17184:x1875537147649024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652044.132632:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17184:x1875537147649024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 122us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652044.132658:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788652044.133385:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147649024:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788652044.138182:0:18371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788652044.138443:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788652044.138471:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788652044.138484:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652044.138496:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652044.138506:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788652044.138508:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86c3255800 from 13 10000000:01000000:1.0:1788652044.138511:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788652044.138565:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652044.138572:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652044.138584:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652044.138610:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147649152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788652044.138682:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652044.138727:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bd9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652044.138899:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147649152 00000100:00100000:0.0:1788652044.138984:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147649152 00000100:00100000:0.0:1788652044.139025:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788652044.139035:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+17:17184:x1875537147649152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652044.139048:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652044.139063:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4f48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4f41 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652044.139087:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f41 expref: 18 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652044.139098:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f41 expref: 18 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652044.139106:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b97600, rc 0) 00000100:00100000:0.0:1788652044.139148:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17184:x1875537147649152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652044.139154:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788652044.139434:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147649152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652044.139451:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652044.139460:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652044.139517:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147649280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652044.139546:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652044.139586:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bd9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652044.139792:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147649280 00000100:00100000:0.0:1788652044.139798:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147649280 00000100:00100000:0.0:1788652044.139830:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788652044.139837:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17184:x1875537147649280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652044.140131:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17184:x1875537147649280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 294us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652044.140138:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788652044.140245:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147649280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652044.140281:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147649408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652044.140322:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652044.140350:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bd9780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652044.140400:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147649408 00000100:00100000:0.0:1788652044.140405:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147649408 00000100:00100000:0.0:1788652044.140478:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788652044.140486:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17184:x1875537147649408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652044.140587:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:17184:x1875537147649408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 102us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652044.140594:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788652044.141995:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147649408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788652044.143038:0:18372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788652044.151173:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788652044.151225:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788652044.151252:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652044.151265:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652044.258585:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652044.258610:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147649536:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652044.258701:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652044.258879:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147649536 00000100:00100000:1.0:1788652044.258952:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147649536 00000100:00100000:1.0:1788652044.259009:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788652044.259019:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147649536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788652044.259067:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788652044.259130:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147649536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652044.259137:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788652044.259160:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788652044.259359:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147649664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652044.259389:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652044.259428:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147649664 00000100:00100000:1.0:1788652044.259433:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147649664 00000100:00100000:1.0:1788652044.259457:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788652044.259464:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875537147649664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652044.259483:0:18173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652044.259519:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3636:x1875537147649664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652044.259525:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788652044.259576:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147649664:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652044.259606:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147649536:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788652044.773751:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788652044.836053:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788652045.154007:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788652045.862966:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652046.880091:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652047.906360:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652048.355166:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:0.0:1788652048.355170:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652048.355176:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652048.355179:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652048.355182:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652048.355199:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652048.355202:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788652048.355205:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652048.355209:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788652048.355223:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147650176:0@lo:400:kworker.0 00000100:00100000:0.0:1788652048.355237:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147649920:0@lo:400:kworker.0 00000100:00100000:2.0:1788652048.355317:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147650304:0@lo:400:kworker.0 00000100:00100000:0.0:1788652048.355537:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652048.355596:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788652048.355602:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147650048:0@lo:400:kworker.0 00000100:00100000:0.0:1788652048.355646:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652048.355681:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147649920 00000100:00100000:0.0:1788652048.355688:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147649920 00000100:00100000:0.0:1788652048.355744:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788652048.355754:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147649920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652048.355821:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147649920:12345-0@lo:400:kworker.0 Request processed in 67us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652048.355829:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788652048.355857:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147650048 00000100:00100000:0.0:1788652048.356020:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147650048 00000100:00100000:0.0:1788652048.356077:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652048.356085:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147650048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652048.356119:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147650048:12345-0@lo:400:kworker.0 Request processed in 35us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652048.356125:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788652048.356177:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86f48d2d80 x1875537147650048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652048.356190:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147650048:0@lo:400:kworker.0 00000100:00100000:0.0:1788652048.356199:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147649920:0@lo:400:kworker.0 00000100:00100000:2.0:1788652048.359561:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652048.359649:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147650304 00000100:00100000:2.0:1788652048.359673:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147650304 00000100:00100000:2.0:1788652048.359721:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652048.359741:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147650304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652048.359811:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147650304:12345-0@lo:400:kworker.0 Request processed in 82us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652048.359819:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652048.359981:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652048.360017:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147649792:0@lo:400:kworker.0 00000100:00100000:1.0:1788652048.360049:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788652048.360760:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86d109a680 x1875537147650304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652048.360777:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147650304:0@lo:400:kworker.0 00000100:00100000:2.0:1788652048.360861:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147650176 00000100:00100000:2.0:1788652048.360868:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147650176 00000100:00100000:2.0:1788652048.360944:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788652048.360952:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147650176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652048.360996:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147649792 00000100:00100000:1.0:1788652048.361001:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147649792 00000100:00100000:1.0:1788652048.361035:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788652048.361042:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:3635:x1875537147649792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652048.361182:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:3635:x1875537147649792:12345-0@lo:400:kworker.0 Request processed in 54us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652048.361191:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788652048.361451:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147649792:0@lo:400:kworker.0 00000100:00100000:2.0:1788652048.363388:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147650176:12345-0@lo:400:kworker.0 Request processed in 2428us (3398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652048.363401:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788652048.363526:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147650176:0@lo:400:kworker.0 00010000:00010000:0.0:1788652048.928723:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652049.376090:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147650432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652049.376178:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652049.376249:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147650432 00000100:00100000:1.0:1788652049.376257:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147650432 00000100:00100000:1.0:1788652049.376310:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788652049.376333:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147650432:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652049.376369:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652049.376413:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147650432:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652049.376421:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788652049.376778:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147650432:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652049.379475:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147650560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788652049.379553:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652049.379664:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147650560 00000100:00100000:3.0:1788652049.379675:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147650560 00000100:00100000:3.0:1788652049.379737:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788652049.379747:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147650560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788652049.379779:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788652049.379826:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147650560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652049.379833:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788652049.379944:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147650560:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788652049.632767:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788652049.955082:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788652050.773815:0:18687:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788652050.773821:0:18687:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788652050.773822:0:18687:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788652050.775904:0:18687:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f86c6e8c000 00000020:01000004:3.0:1788652050.775967:0:18687:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788652050.775995:0:18687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788652050.776010:0:18687:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8f86c8db19c0) 00000020:00000080:3.0:1788652050.776033:0:18687:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788652050.937774:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788652050.941877:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788652050.948094:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788652050.949176:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788652050.953980:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788652050.954595:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788652050.956272:0:18687:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:2.0:1788652050.963329:0:18687:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788652050.964277:0:18687:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788652050.964292:0:18687:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788652050.964306:0:18687:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd2f56ea038c4f56 00000020:01000004:2.0:1788652050.964313:0:18687:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788652050.964335:0:18687:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788652050.964338:0:18687:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788652050.964344:0:18687:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788652050.964349:0:18687:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788652050.964361:0:18687:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8f85c2930000) 00000020:00000080:2.0:1788652050.964372:0:18687:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1788652050.972086:0:18687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652050.972290:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788652050.972297:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788652050.973245:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788652050.973254:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788652050.974626:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788652050.974706:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00010000:00010000:2.0:1788652050.978266:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652050.986886:0:18687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788652050.987108:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788652050.987115:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788652050.987948:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788652050.987955:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788652051.024082:0:18687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788652051.024370:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788652051.024376:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788652051.029995:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788652051.030016:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788652051.038760:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788652051.038780:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788652051.041496:0:18687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788652051.041719:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788652051.041725:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788652051.051054:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788652051.051075:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788652051.137942:0:18687:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788652051.140763:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788652051.140777:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788652051.146463:0:18687:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788652051.146482:0:18687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788652051.149700:0:18687:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788652051.149737:0:18687:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1788652051.149745:0:18687:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788652051.173618:0:18687:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788652051.173666:0:18687:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.145@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788652051.173671:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788652051.173672:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788652051.173674:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652051.173675:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652051.173676:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652051.173677:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652051.173679:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788652051.173681:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652051.173682:0:18687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788652051.173685:0:18687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788652051.173687:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788652051.173688:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788652051.173689:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652051.173690:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652051.173691:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652051.173692:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652051.173694:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788652051.173695:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652051.173696:0:18687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788652051.173722:0:18687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788652051.173741:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147650688:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788652051.173884:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652051.173960:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc480 going to sleep for 11 seconds 00000100:00100000:1.0:1788652051.174025:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147650688 00000100:00100000:1.0:1788652051.174042:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147650688 00000100:00100000:1.0:1788652051.174106:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788652051.174115:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:18687:x1875537147650688:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788652051.174159:0:17182:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788652051.174163:0:17182:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788652051.174166:0:17182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788652051.174745:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:18687:x1875537147650688:12345-0@lo:253:mount.lustre.0 Request processed in 630us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652051.174753:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788652051.174841:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147650688:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788652051.174854:0:18687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788652051.174856:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788652051.174857:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788652051.174858:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652051.174859:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652051.174869:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652051.174870:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652051.174871:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652051.174872:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652051.174873:0:18687:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788652051.174892:0:18687:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f86c6e8c000 from lustre-OST0000 10000000:01000000:2.0:1788652051.174957:0:18687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788652051.174961:0:18687:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788652051.174970:0:18687:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f85c2ae4d40 local copy 00010000:00010000:2.0:1788652051.174980:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652051.175074:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147650816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652051.175117:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652051.175141:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652051.175254:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147650816 00000100:00100000:1.0:1788652051.175260:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147650816 00000100:00100000:1.0:1788652051.175299:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788652051.175307:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:18687:x1875537147650816:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652051.175396:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:18687:x1875537147650816:12345-0@lo:501:mount.lustre.0 Request processed in 88us (277us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788652051.175403:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788652051.175607:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147650816:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788652051.175625:0:18687:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788652051.175649:0:18687:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788652051.175656:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652051.175665:0:18687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652051.175692:0:18687:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f86c6e8c000 10000000:01000000:3.0:1788652051.175696:0:18687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788652051.175701:0:18687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788652051.175704:0:18687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788652051.175708:0:18687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788652051.175718:0:18687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788652051.175743:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652051.175752:0:18687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652051.175761:0:18687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652051.175774:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147650944:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652051.175843:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.175873:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652051.176196:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147650944 00000100:00100000:0.0:1788652051.176202:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147650944 00000100:00100000:0.0:1788652051.176228:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788652051.176235:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+18:18687:x1875537147650944:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652051.176244:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652051.176258:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b96c00/0xcd2f56ea038c4f6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4f64 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652051.176288:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b96c00/0xcd2f56ea038c4f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f64 expref: 19 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652051.176298:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b96c00/0xcd2f56ea038c4f6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f64 expref: 19 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652051.176306:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96c00, rc 0) 00000100:00100000:0.0:1788652051.176339:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:18687:x1875537147650944:12345-0@lo:101:mount.lustre.0 Request processed in 104us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652051.176345:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788652051.176442:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147650944:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652051.176456:0:18687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652051.176465:0:18687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652051.184537:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788652051.186329:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652051.191690:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788652051.191764:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788652051.191781:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788652051.191797:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788652051.191812:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788652051.192393:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788652051.192566:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788652051.192574:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788652051.192730:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652051.192806:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.193362:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652051.194026:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147651072 00000100:00100000:0.0:1788652051.194115:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147651072 00000100:00100000:0.0:1788652051.194332:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788652051.194343:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:18687:x1875537147651072:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652051.194550:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:18687:x1875537147651072:12345-0@lo:501:mount.lustre.0 Request processed in 209us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652051.194558:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788652051.194646:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651072:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652051.194691:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651200:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652051.194744:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.198270:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952240 going to sleep for 11 seconds 00000100:00100000:2.0:1788652051.198270:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147651200 00000100:00100000:2.0:1788652051.198286:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147651200 00000100:00100000:2.0:1788652051.198343:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788652051.198353:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:18687:x1875537147651200:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652051.200778:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:18687:x1875537147651200:12345-0@lo:503:mount.lustre.0 Request processed in 2417us (6024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652051.200793:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788652051.201000:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651200:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788652051.201742:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652051.202786:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652051.202929:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.202974:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652051.203074:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147651328 00000100:00100000:0.0:1788652051.203082:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147651328 00000100:00100000:0.0:1788652051.203149:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788652051.203159:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:18687:x1875537147651328:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652051.207316:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:18687:x1875537147651328:12345-0@lo:502:mount.lustre.0 Request processed in 4144us (4397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652051.207335:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788652051.207526:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652051.207777:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788652051.207812:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788652051.207840:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788652051.207855:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788652051.207870:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788652051.207881:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788652051.207894:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788652051.207950:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788652051.207989:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788652051.208008:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788652051.208022:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788652051.208037:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788652051.208075:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651456:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652051.208133:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.208186:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652051.208314:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147651456 00000100:00100000:1.0:1788652051.208321:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147651456 00000100:00100000:1.0:1788652051.208371:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788652051.208381:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:18687:x1875537147651456:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652051.208510:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:18687:x1875537147651456:12345-0@lo:502:mount.lustre.0 Request processed in 131us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652051.208517:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788652051.208959:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651456:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788652051.209025:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788652051.209034:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788652051.211421:0:18704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788652051.211433:0:18704:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788652051.211442:0:18704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788652051.211444:0:18704:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788652051.211451:0:18704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788652051.211594:0:18704:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8f85c3d33380) 00000020:00000080:0.0:1788652051.211625:0:18704:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788652051.211634:0:18704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788652051.211721:0:18704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86c6e8c000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788652051.211732:0:18704:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788652051.211739:0:18704:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xcd2f56ea038c4f79 00010000:00010000:1.0:1788652051.223239:0:18704:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788652051.223790:0:18704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:1.0:1788652051.226321:0:18704:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:3.0:1788652051.227792:0:18704:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788652051.227804:0:18704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652051.227811:0:18704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652051.227813:0:18704:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788652051.227830:0:18704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788652051.227833:0:18704:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1788652051.227835:0:18704:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788652051.227837:0:18704:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788652051.227838:0:18704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788652051.227841:0:18704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652051.227842:0:18704:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788652051.227844:0:18704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652051.227848:0:18704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652051.227849:0:18704:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788652051.227852:0:18704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788652051.227853:0:18704:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788652051.227856:0:18704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652051.227858:0:18704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652051.227859:0:18704:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788652051.227861:0:18704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652051.227863:0:18704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652051.227865:0:18704:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788652051.227868:0:18704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788652051.227893:0:18704:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652051.227896:0:18704:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652051.227897:0:18704:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788652051.228566:0:18704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788652051.229037:0:18687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788652051.229072:0:18687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788652051.229102:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.229115:0:18687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f0906800/0xcd2f56ea038c4f64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f6b expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652051.229124:0:18687:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86c6e8c000 from 1 10000000:01000000:1.0:1788652051.229128:0:18687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788652051.229211:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.229221:0:18687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.229233:0:18687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652051.229263:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651584:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788652051.229342:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652051.229389:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3f39840 going to sleep for 11 seconds 00000100:00100000:1.0:1788652051.231057:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147651584 00000100:00100000:1.0:1788652051.231074:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147651584 00000100:00100000:1.0:1788652051.231144:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788652051.231155:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:18687:x1875537147651584:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652051.231169:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652051.231192:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4f87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4f80 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.231222:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4f87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f80 expref: 20 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.231233:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4f87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f80 expref: 20 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.231241:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9600, rc 0) 00000100:00100000:1.0:1788652051.231319:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:18687:x1875537147651584:12345-0@lo:101:mount.lustre.0 Request processed in 166us (1977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652051.231326:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788652051.231389:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651584:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652051.231467:0:18687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.231477:0:18687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788652051.232897:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788652051.233345:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652051.235947:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788652051.235999:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788652051.236024:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788652051.236029:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788652051.236149:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651712:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652051.236217:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652051.236263:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3f39600 going to sleep for 11 seconds 00000100:00100000:0.0:1788652051.236355:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147651712 00000100:00100000:0.0:1788652051.236363:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147651712 00000100:00100000:0.0:1788652051.236417:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788652051.236426:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:18687:x1875537147651712:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652051.236545:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:18687:x1875537147651712:12345-0@lo:501:mount.lustre.0 Request processed in 120us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652051.236552:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788652051.236769:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652051.236805:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652051.236858:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652051.236886:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2a6a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788652051.237104:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147651840 00000100:00100000:1.0:1788652051.237109:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147651840 00000100:00100000:1.0:1788652051.238256:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788652051.238270:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:18687:x1875537147651840:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652051.238408:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:18687:x1875537147651840:12345-0@lo:503:mount.lustre.0 Request processed in 141us (1548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652051.238414:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788652051.238507:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651840:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788652051.238968:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652051.239054:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651968:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652051.239123:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.240038:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652051.240138:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147651968 00000100:00100000:0.0:1788652051.240146:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147651968 00000100:00100000:0.0:1788652051.240185:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788652051.240193:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:18687:x1875537147651968:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652051.240318:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:18687:x1875537147651968:12345-0@lo:502:mount.lustre.0 Request processed in 125us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652051.240326:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788652051.240420:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147651968:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652051.240623:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788652051.240651:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788652051.240678:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788652051.240693:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788652051.240706:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788652051.240718:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788652051.240731:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788652051.240744:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788652051.240757:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788652051.240769:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788652051.240783:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788652051.240812:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652096:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652051.240869:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.240895:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788652051.243384:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147652096 00000100:00100000:0.0:1788652051.243417:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147652096 00000100:00100000:0.0:1788652051.243465:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788652051.243484:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:18687:x1875537147652096:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652051.243646:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:18687:x1875537147652096:12345-0@lo:502:mount.lustre.0 Request processed in 172us (2776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652051.243666:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788652051.244337:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652096:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652051.244627:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788652051.244644:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788652051.245671:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652051.245682:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652051.245684:0:18708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788652051.245691:0:18708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86c6e8c000 00000020:00000080:2.0:1788652051.245699:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652051.245708:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652051.245711:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652051.245712:0:18708:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788652051.245715:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652051.245717:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652051.245718:0:18708:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788652051.245721:0:18708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86c6e8c000 00000020:00000080:2.0:1788652051.245723:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652051.246029:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652051.246034:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652051.246035:0:18708:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788652051.246038:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652051.246041:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652051.246042:0:18708:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788652051.246046:0:18708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86c6e8c000 00000020:00000080:2.0:1788652051.246048:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652051.247611:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652051.247621:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652051.247623:0:18708:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788652051.247627:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788652051.247630:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652051.247632:0:18708:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788652051.247636:0:18708:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86c6e8c000 00000020:00000080:2.0:1788652051.247638:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788652051.247690:0:18708:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788652051.247693:0:18708:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788652051.247695:0:18708:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788652051.247698:0:18708:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788652051.250393:0:18687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788652051.250452:0:18687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788652051.250473:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652051.250601:0:18687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652051.250663:0:18687:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788652051.250666:0:18687:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f86c6e8c000 10000000:01000000:0.0:1788652051.250670:0:18687:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f86c6e8c000 10000000:01000000:0.0:1788652051.250674:0:18687:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788652051.250681:0:18687:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86c6e8c000 from 1 10000000:01000000:0.0:1788652051.250683:0:18687:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788652051.250723:0:18687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652051.250732:0:18687:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652051.250744:0:18687:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652051.250768:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788652051.250941:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652051.250986:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147652224 00000100:00100000:0.0:1788652051.250994:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147652224 00000100:00100000:0.0:1788652051.251038:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788652051.251048:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:18687:x1875537147652224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652051.251060:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652051.251072:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b96800/0xcd2f56ea038c4f95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4f8e expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652051.251107:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b96800/0xcd2f56ea038c4f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f8e expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652051.251118:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b96800/0xcd2f56ea038c4f95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f8e expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652051.251127:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96800, rc 0) 00000100:00100000:0.0:1788652051.251160:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147652224:12345-0@lo:101:mount.lustre.0 Request processed in 113us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652051.251166:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788652051.251212:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81f7000 going to sleep for 11 seconds 00000100:00100000:0.0:1788652051.251234:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652051.251248:0:18687:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652051.251256:0:18687:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652051.252744:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788652051.253149:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652051.253343:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788652051.253369:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788652051.253383:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788652051.253396:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788652051.256762:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788652051.256806:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788652051.257583:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788652051.257605:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788652051.257618:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788652051.257629:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788652051.257643:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788652051.257657:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788652051.257671:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788652051.257684:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788652051.257699:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788652051.257714:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788652051.257726:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788652051.257737:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788652051.257751:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788652051.257765:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788652051.257797:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788652051.257814:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788652051.258977:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788652051.258996:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788652051.259012:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788652051.259028:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788652051.259044:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788652051.259058:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788652051.259074:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788652051.259089:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788652051.259119:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788652051.259147:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788652051.259177:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788652051.259192:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788652051.259206:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788652051.259220:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788652051.266701:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788652051.266748:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788652051.266754:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788652051.266890:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652352:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652051.266986:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652051.267044:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81f7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788652051.273548:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147652352 00000100:00100000:2.0:1788652051.273565:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147652352 00000100:00100000:2.0:1788652051.273634:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788652051.273644:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147652352:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652051.275321:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147652352:12345-0@lo:501:mount.lustre.0 Request processed in 1671us (8328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652051.275333:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788652051.283725:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652352:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652051.283794:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652051.285033:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652051.286529:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34d3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652051.290614:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147652480 00000100:00100000:2.0:1788652051.290631:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147652480 00000100:00100000:2.0:1788652051.292173:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788652051.292190:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147652480:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788652051.292359:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147652480:12345-0@lo:503:mount.lustre.0 Request processed in 174us (7332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652051.292367:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788652051.293345:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652480:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788652051.294081:0:18687:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788652051.294188:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652608:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652051.294260:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652051.295144:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2b31000 going to sleep for 11 seconds 00000100:00100000:3.0:1788652051.295177:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147652608 00000100:00100000:3.0:1788652051.295186:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147652608 00000100:00100000:3.0:1788652051.295231:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788652051.295241:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147652608:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652051.295494:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147652608:12345-0@lo:502:mount.lustre.0 Request processed in 254us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652051.295502:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788652051.299831:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652608:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788652051.300135:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788652051.300169:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788652051.300184:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788652051.300197:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788652051.300212:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788652051.300223:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788652051.300236:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788652051.300249:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788652051.300263:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788652051.300283:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788652051.300296:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788652051.300309:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788652051.300321:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788652051.300333:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788652051.300344:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788652051.300356:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788652051.300368:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788652051.300381:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788652051.300395:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788652051.300433:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788652051.300448:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788652051.301938:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788652051.301996:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788652051.302011:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788652051.302025:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1788652051.302038:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1788652051.302051:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1788652051.302063:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1788652051.302078:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1788652051.302103:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1788652051.302119:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1788652051.302133:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1788652051.302147:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1788652051.302162:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1788652051.302176:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1788652051.302191:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1788652051.302203:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1788652051.302237:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1788652051.302254:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1788652051.302266:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1788652051.302279:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1788652051.302292:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1788652051.302306:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1788652051.302319:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1788652051.302333:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1788652051.302344:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1788652051.302354:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1788652051.302366:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1788652051.303585:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652736:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652051.303671:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652051.303780:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81f7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652051.309307:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147652736 00000100:00100000:1.0:1788652051.309322:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147652736 00000100:00100000:1.0:1788652051.309440:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788652051.309452:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147652736:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652051.310680:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147652736:12345-0@lo:502:mount.lustre.0 Request processed in 1226us (7004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652051.310691:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788652051.310754:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652736:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652051.311028:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788652051.311066:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788652051.311118:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652864:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652051.311178:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652051.315018:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147652864 00000100:00100000:0.0:1788652051.315037:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147652864 00000100:00100000:0.0:1788652051.315105:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788652051.315117:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147652864:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652051.315136:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652051.315312:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147652864:12345-0@lo:502:mount.lustre.0 Request processed in 197us (4133us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652051.315321:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788652051.318124:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147652864:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788652051.318251:0:18687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788652051.318268:0:18687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788652051.322466:0:18714:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788652051.322486:0:18714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8f86c8db0000) 00000020:00000080:3.0:1788652051.322512:0:18714:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:3.0:1788652051.322616:0:18714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86c6e8c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788652051.322622:0:18714:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86c6e8c000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788652051.322625:0:18714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86c6e8c000 3 00010000:00080000:3.0:1788652051.322664:0:18714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f86eeab9000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788652051.330516:0:18714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788652051.330736:0:18714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788652051.330788:0:18714:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788652051.330802:0:18714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xcd2f56ea038c4fa3 00000100:00080000:2.0:1788652051.330813:0:18714:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652051.330833:0:18714:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8f86eeab9000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652051.330871:0:18714:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff446a00 x1875537147652992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652051.330892:0:18714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788652051.332632:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652051.332638:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652051.332641:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652051.332645:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652051.332673:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652051.332676:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652051.332679:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652051.332682:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788652051.332731:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147653120:0@lo:400:kworker.0 00000100:00100000:3.0:1788652051.332876:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.332941:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652051.332948:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147653248:0@lo:400:kworker.0 00000100:00100000:3.0:1788652051.332976:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.333027:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147653376:0@lo:400:kworker.0 00000100:00100000:3.0:1788652051.333058:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.333078:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652051.333084:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147653504:0@lo:400:kworker.0 00000100:00100000:3.0:1788652051.333125:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.333178:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147653120 00000100:00100000:3.0:1788652051.333186:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147653120 00000100:00100000:3.0:1788652051.333316:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147653376 00000100:00100000:3.0:1788652051.333320:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147653376 00000100:00100000:3.0:1788652051.333340:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788652051.333348:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147653120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652051.333414:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788652051.333417:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147653120:12345-0@lo:400:kworker.0 Request processed in 68us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652051.333428:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147653376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652051.333430:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788652051.333465:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147653248 00000100:00100000:3.0:1788652051.333470:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147653248 00000100:00100000:2.0:1788652051.333496:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147653376:12345-0@lo:400:kworker.0 Request processed in 71us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652051.333497:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147653504 00000100:00100000:3.0:1788652051.333501:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147653504 00000100:00100000:2.0:1788652051.333510:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788652051.333523:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652051.333532:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147653248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652051.333567:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147653248:12345-0@lo:400:kworker.0 Request processed in 36us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652051.333574:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652051.333591:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652051.333599:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147653504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652051.333631:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147653504:12345-0@lo:400:kworker.0 Request processed in 34us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652051.333637:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788652051.333688:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86ff462d80 x1875537147653248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652051.333706:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147653248:0@lo:400:kworker.0 00000100:00100000:3.0:1788652051.333719:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147653120:0@lo:400:kworker.0 00010000:00080000:3.0:1788652051.333755:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86ff460380 x1875537147653504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652051.333765:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147653504:0@lo:400:kworker.0 00000100:00100000:3.0:1788652051.333776:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147653376:0@lo:400:kworker.0 00000100:00100000:1.0:1788652051.334409:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147652992:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788652051.334481:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.334707:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147652992 00000100:00100000:3.0:1788652051.334714:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147652992 00000100:00100000:3.0:1788652051.334792:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652051.334799:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875537147652992:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788652051.334828:0:17188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:3.0:1788652051.334869:0:17188:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xcd2f56ea038c4faa 00000004:00100000:3.0:1788652051.334886:0:17188:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788652051.334944:0:17188:0:(import.c:65:import_set_state_nolock()) ffff8f86c6d46000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652051.335004:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3634:x1875537147652992:12345-0@lo:38:llog_process_th.0 Request processed in 204us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652051.335012:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:2.0:1788652051.335086:0:18714:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788652051.335111:0:18714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8f86f560cd40) 00000020:00000080:2.0:1788652051.335138:0:18714:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788652051.335223:0:18714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86c6e8c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788652051.335227:0:18714:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86c6e8c000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788652051.335230:0:18714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86c6e8c000 3 00010000:00080000:2.0:1788652051.335259:0:18714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c1970800@lustre-MDT0001-lwp-OST0000: add connection 192.168.204.145@tcp at head 00010000:00010000:2.0:1788652051.339068:0:18714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00010000:00080000:3.0:1788652051.339151:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86ff446a00 x1875537147652992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652051.339164:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788652051.339177:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788652051.339185:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788652051.339201:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788652051.339205:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86eeab9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788652051.339214:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3634:1875537147652992:0@lo:38:llog_process_th.0 00000020:00000080:2.0:1788652051.339296:0:18714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788652051.339344:0:18714:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788652051.339357:0:18714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xcd2f56ea038c4fb8 00000100:00080000:2.0:1788652051.339365:0:18714:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788652051.339370:0:18714:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8f85c1970800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652051.339428:0:18714:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff445f80 x1875537147653632/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652051.339442:0:18714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1788652051.340587:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875537147653632:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788652051.340681:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788652051.340744:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652051.340750:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652051.340753:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652051.340756:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652051.340760:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1788652051.340763:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147653632 00000100:00080000:3.0:1788652051.340764:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652051.340770:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652051.340773:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788652051.340774:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147653632 00000100:00100000:3.0:1788652051.340826:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788652051.340836:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875537147653632:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788652051.340866:0:17188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 507 last 0 00000020:00000080:3.0:1788652051.340949:0:17188:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xcd2f56ea038c4fbf 00000004:00100000:3.0:1788652051.340967:0:17188:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788652051.341005:0:17188:0:(import.c:65:import_set_state_nolock()) ffff8f86c4e7e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652051.341065:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3634:x1875537147653632:12345-0@lo:38:llog_process_th.0 Request processed in 229us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652051.341073:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788652051.341139:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8f86ff445f80 x1875537147653632/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652051.341149:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788652051.341156:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788652051.341162:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788652051.341167:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788652051.341169:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c1970800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788652051.341175:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff445f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3634:1875537147653632:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788652051.346324:0:18714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1788652051.346757:0:18687:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788652051.346804:0:18687:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788652051.346833:0:18687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.346847:0:18687:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97c00/0xcd2f56ea038c4f8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4f95 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788652051.346904:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788652051.346926:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788652051.346928:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652051.346929:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652051.346930:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652051.346932:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652051.346933:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652051.346936:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652051.346937:0:18687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788652051.346941:0:18687:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788652051.346944:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788652051.346945:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788652051.346946:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652051.346947:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652051.346948:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652051.346949:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652051.346950:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652051.346951:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652051.346952:0:18687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788652051.346982:0:18687:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788652051.347004:0:18687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147653760:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788652051.347073:0:18687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652051.347119:0:18687:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86e0285480 going to sleep for 11 seconds 00000100:00100000:0.0:1788652051.348087:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147653760 00000100:00100000:0.0:1788652051.348124:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147653760 00000100:00100000:0.0:1788652051.348185:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788652051.348196:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:18687:x1875537147653760:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788652051.348228:0:17182:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788652051.348245:0:17182:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788652051.352616:0:17182:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788652051.352637:0:17182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788652051.352707:0:17202:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788652051.352713:0:17202:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788652051.352737:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.352757:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86f4b97a00/0xcd2f56ea038c4f10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f09 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.352773:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f17 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.352780:0:17202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.352826:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4f17 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.352841:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f17 expref: 21 pid: 17179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652051.352856:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147653888:0@lo:104: 00000100:00100000:1.0:1788652051.352953:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788652051.352996:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86f4b97a00/0xcd2f56ea038c4f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4f09 expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.353006:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86f4b97a00/0xcd2f56ea038c4f10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f09 expref: 21 pid: 17179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652051.353015:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147654016:0@lo:104: 00000100:00100000:2.0:1788652051.353031:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147653888 00000100:00100000:2.0:1788652051.353041:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147653888 00000100:00100000:1.0:1788652051.353045:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652051.353070:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86e0285e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652051.353086:0:17170:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788652051.353109:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147654016 00000100:00100000:2.0:1788652051.353111:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147654016 00000100:00100000:2.0:1788652051.353128:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652051.353137:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+4:17202:x1875537147653888:12345-0@lo:104: 00010000:00010000:2.0:1788652051.353151:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.353239:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788652051.353245:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+4:17202:x1875537147653888:12345-0@lo:104: Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652051.353261:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652051.353280:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652051.353286:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f58ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:17202:x1875537147654016:12345-0@lo:104: 00010000:00010000:2.0:1788652051.353295:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.353327:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788652051.353333:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f58ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:17202:x1875537147654016:12345-0@lo:104: Request processed in 48us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652051.353338:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788652051.353379:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652051.353385:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.353392:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f8c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788652051.353397:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.353405:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652051.353413:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652051.353418:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652051.353445:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.353452:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788652051.353722:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368f100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147653888:0@lo:104: 00000100:00100000:1.0:1788652051.353732:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147654016:0@lo:104: 00010000:00010000:1.0:1788652051.353751:0:17202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.354272:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.354282:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f8c00/0xcd2f56ea038c4f17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f1e expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.354296:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652051.354299:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.354306:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9000 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788652051.354309:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.354316:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652051.354322:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652051.354328:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652051.354348:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.354355:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652051.354362:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.354368:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9000/0xcd2f56ea038c4f09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f10 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.354393:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652051.354395:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652051.354396:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652051.354402:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652051.354422:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147654144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652051.354465:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652051.355154:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788652051.355165:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147654272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652051.355201:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652051.355647:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147654144 00000100:00100000:2.0:1788652051.355680:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147654272 00000100:00100000:2.0:1788652051.355686:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147654272 00010000:00010000:2.0:1788652051.355713:0:17173:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86f4b97a00/0xcd2f56ea038c4f10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f09 expref: 22 pid: 17179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652051.355714:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147654144 00010000:00010000:3.0:1788652051.355739:0:17174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f17 expref: 23 pid: 17179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652051.355751:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788652051.355767:0:17174:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788652051.355774:0:17174:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788652051.355884:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:3635:x1875537147654272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652051.355898:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788652051.356084:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788652051.356104:0:17173:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86f4b97a00/0xcd2f56ea038c4f10 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f09 expref: 23 pid: 17179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652051.356109:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:3635:x1875537147654144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652051.356122:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652051.356127:0:17173:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86f4b97a00/0xcd2f56ea038c4f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f09 expref: 23 pid: 17179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652051.356131:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f17 expref: 23 pid: 17179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.356751:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b97a00/0xcd2f56ea038c4f10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4f09 expref: 23 pid: 17179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652051.356757:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f17 expref: 23 pid: 17179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652051.356774:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f8000/0xcd2f56ea038c4f1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4f17 expref: 22 pid: 17179 timeout: 607 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.360214:0:17173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.360258:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788652051.360282:0:17173:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011767327s 00010000:00010000:2.0:1788652051.360290:0:17173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.360297:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.360305:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.360313:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.360320:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f8600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652051.360324:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.360333:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.360361:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652051.360376:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788652051.360568:0:17202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.360580:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652051.360588:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c4fc6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652051.360591:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:3635:x1875537147654272:12345-0@lo:103:ldlm_bl.0 Request processed in 4709us (5385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652051.360608:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652051.360716:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:18687:x1875537147653760:12345-0@lo:253:mount.lustre.0 Request processed in 12522us (13641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652051.360725:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788652051.360892:0:18687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:18687:1875537147653760:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788652051.360921:0:18687:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788652051.360925:0:18687:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788652051.360926:0:18687:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788652051.360928:0:18687:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788652051.360929:0:18687:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788652051.360930:0:18687:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788652051.360932:0:18687:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788652051.360933:0:18687:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788652051.360935:0:18687:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788652051.360936:0:18687:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788652051.360956:0:18687:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1788652051.361784:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff446300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147654272:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652051.362692:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652051.362780:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:3635:x1875537147654144:12345-0@lo:103:ldlm_bl.0 Request processed in 6686us (8311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652051.362800:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788652051.363252:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff447b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147654144:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1788652051.380428:0:18687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788652051.383818:0:18687:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788652051.383827:0:18687:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788652051.383864:0:18687:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788652051.383941:0:18687:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788652051.383964:0:18687:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788652051.383993:0:18687:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788652051.386078:0:18687:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788652051.386996:0:18687:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788652052.004352:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788652052.340085:0:18769:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788652052.340307:0:18769:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788652053.028929:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788652053.154456:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788652053.154463:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f85c3548800 from 9 10000000:01000000:0.0:1788652053.154468:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788652053.154514:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652053.154533:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652053.154545:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652053.154570:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147654400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652053.154637:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652053.154682:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81f7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788652053.154823:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147654400 00000100:00100000:2.0:1788652053.154834:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147654400 00000100:00100000:2.0:1788652053.155053:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788652053.155073:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+19:17184:x1875537147654400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652053.155085:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652053.155098:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c4fd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4fcd expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652053.155120:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c4fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4fcd expref: 20 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652053.155131:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c4fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4fcd expref: 20 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652053.155141:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6c00, rc 0) 00000100:00100000:2.0:1788652053.155180:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:17184:x1875537147654400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652053.155186:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788652053.155266:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147654400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652053.155280:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652053.155297:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652053.155348:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147654528:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788652053.155388:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652053.155410:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652053.155504:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147654528 00000100:00100000:0.0:1788652053.155509:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147654528 00000100:00100000:0.0:1788652053.155541:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788652053.155547:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:17184:x1875537147654528:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788652053.155559:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788652053.155574:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788652053.155578:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788652053.155640:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:17184:x1875537147654528:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 93us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652053.155647:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788652053.155673:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147654528:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788652053.155723:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788652053.155730:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652053.155738:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652053.155755:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788652053.155757:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86c3255800 from 9 10000000:01000000:0.0:1788652053.155759:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788652053.155775:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652053.155782:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652053.155792:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652053.155806:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147654656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652053.155830:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652053.155843:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81f7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652053.155853:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147654656 00000100:00100000:0.0:1788652053.155856:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147654656 00000100:00100000:0.0:1788652053.155885:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788652053.155891:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:17184:x1875537147654656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652053.155897:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652053.156529:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f4b96e00/0xcd2f56ea038c4fe2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c4fdb expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652053.156552:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f4b96e00/0xcd2f56ea038c4fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c4fdb expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652053.156561:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f4b96e00/0xcd2f56ea038c4fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4fdb expref: 21 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652053.156585:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f4b96e00, rc 0) 00000100:00100000:0.0:1788652053.156628:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:17184:x1875537147654656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 736us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652053.156634:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788652053.156694:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147654656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652053.156713:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652053.156720:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652053.156768:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147654784:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788652053.156801:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652053.156816:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c81f7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788652053.156830:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147654784 00000100:00100000:0.0:1788652053.156834:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147654784 00000100:00100000:0.0:1788652053.156855:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788652053.156860:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:17184:x1875537147654784:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788652053.157228:0:17179:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788652053.157243:0:17179:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788652053.157246:0:17179:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788652053.157534:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:17184:x1875537147654784:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 672us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652053.157542:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788652053.167081:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147654784:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788652053.167177:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788652053.167188:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652053.167213:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652054.055619:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652054.496288:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147654912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788652054.496396:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652054.496719:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147654912 00000100:00100000:1.0:1788652054.496728:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147654912 00000100:00100000:1.0:1788652054.496779:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788652054.496789:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147654912:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652054.496824:0:18173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652054.496877:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147654912:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652054.496884:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788652054.496957:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147654912:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788652054.496974:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788652054.496981:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147655040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788652054.497007:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652054.497083:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147655040 00000100:00100000:1.0:1788652054.497087:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147655040 00000100:00100000:1.0:1788652054.497127:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788652054.497136:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147655040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788652054.497154:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788652054.497195:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147655040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 61us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652054.497202:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788652054.497268:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147655040:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788652055.073488:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788652055.395110:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788652056.096057:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788652056.544093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652056.544100:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652056.544103:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652056.544116:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652056.544143:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652056.544147:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788652056.544150:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652056.544153:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788652056.544216:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147655424:0@lo:400:kworker.0 00000100:00100000:3.0:1788652056.544286:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652056.544332:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147655936:0@lo:400:kworker.0 00000100:00100000:3.0:1788652056.544354:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652056.544380:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788652056.544385:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147655552:0@lo:400:kworker.0 00000100:00100000:3.0:1788652056.544422:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652056.544466:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147655424 00000100:00100000:3.0:1788652056.544474:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147655424 00000100:00100000:3.0:1788652056.544513:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147655936 00000100:00100000:3.0:1788652056.544516:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147655936 00000100:00100000:3.0:1788652056.544540:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788652056.544548:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147655424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652056.544596:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147655424:12345-0@lo:400:kworker.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652056.544612:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788652056.544629:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788652056.544635:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147655936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652056.544661:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147655936:12345-0@lo:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652056.544667:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788652056.544688:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147655552 00000100:00100000:3.0:1788652056.544692:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147655552 00000100:00100000:3.0:1788652056.544715:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788652056.544720:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147655552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652056.544750:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147655552:12345-0@lo:400:kworker.0 Request processed in 29us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652056.544757:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788652056.544799:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147655552:0@lo:400:kworker.0 00010000:00080000:3.0:1788652056.544814:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86ff462d80 x1875537147655424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652056.544823:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147655424:0@lo:400:kworker.0 00010000:00080000:3.0:1788652056.544831:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86ff460000 x1875537147655936/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652056.544838:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147655936:0@lo:400:kworker.0 00000100:00100000:2.0:1788652056.545049:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147655168:0@lo:400:kworker.0 00000100:00100000:2.0:1788652056.545086:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652056.545122:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147655680:0@lo:400:kworker.0 00000100:00100000:2.0:1788652056.545144:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652056.545164:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788652056.545170:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147655296:0@lo:400:kworker.0 00000100:00100000:2.0:1788652056.545189:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652056.545205:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147655808:0@lo:400:kworker.0 00000100:00100000:2.0:1788652056.545226:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788652056.545266:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788652056.545278:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147655296 00000100:00100000:2.0:1788652056.545282:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147655296 00000100:00100000:2.0:1788652056.545307:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788652056.545314:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147655296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652056.545350:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147655296:12345-0@lo:400:kworker.0 Request processed in 37us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652056.545356:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788652056.545371:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147655680 00000100:00100000:2.0:1788652056.545375:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147655680 00000100:00100000:2.0:1788652056.545394:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147655808 00000100:00100000:2.0:1788652056.545397:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147655808 00000100:00100000:2.0:1788652056.545416:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788652056.545421:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147655680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652056.545460:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3635:x1875537147655680:12345-0@lo:400:kworker.0 Request processed in 38us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652056.545465:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788652056.545477:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788652056.545483:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147655808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652056.545506:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147655808:12345-0@lo:400:kworker.0 Request processed in 24us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652056.545511:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788652056.545526:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652056.545545:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147655296:0@lo:400:kworker.0 00010000:00080000:2.0:1788652056.545555:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86ff461c00 x1875537147655808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652056.545563:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147655808:0@lo:400:kworker.0 00010000:00080000:2.0:1788652056.545573:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86ff461500 x1875537147655680/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652056.545580:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3635:1875537147655680:0@lo:400:kworker.0 00000100:00100000:3.0:1788652056.546516:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147655168 00000100:00100000:3.0:1788652056.546525:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147655168 00000100:00100000:3.0:1788652056.546579:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788652056.546588:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:3635:x1875537147655168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652056.546665:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:3635:x1875537147655168:12345-0@lo:400:kworker.0 Request processed in 78us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652056.546673:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788652056.547169:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147655168:0@lo:400:kworker.0 00010000:00010000:1.0:1788652057.120077:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788652058.037647:0:19059:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788652058.144559:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652058.529104:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652043/real 1788652043] req@ffff8f85c368f800 x1875537147648384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652058 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652058.529139:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f85c368f800 x1875537147648384/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652058 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652058.529182:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652043/real 1788652043] req@ffff8f85c368d880 x1875537147648512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652058 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652058.529195:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f85c368d880 x1875537147648512/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652058 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788652058.529214:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8f800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788652058.529245:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788652058.529249:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147648384:0@lo:8:kworker.0 00000100:00080000:2.0:1788652058.529263:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788652058.529269:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788652058.529272:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147648512:0@lo:8:kworker.0 00000100:00080000:1.0:1788652058.529420:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652058.529424:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652058.529433:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652058.529437:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788652058.529452:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652058.529455:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788652058.529458:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8f800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652058.529463:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 499 00000100:00080000:1.0:1788652058.529468:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788652058.529474:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8f86c6e8f800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652058.529493:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c368dc00 x1875537147656576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788652058.529505:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788652058.529508:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788652058.529510:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788652058.529513:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 499 00000100:00080000:1.0:1788652058.529515:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788652058.529519:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f86c6e8e000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:1.0:1788652058.529529:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c368d500 x1875537147656704/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652058.529569:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147656448:0@lo:400:kworker.0 00000100:00100000:1.0:1788652058.529641:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652058.529676:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788652058.529682:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147656064:0@lo:400:kworker.0 00000100:00100000:1.0:1788652058.529710:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652058.529736:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147656832:0@lo:400:kworker.0 00000100:00100000:1.0:1788652058.529767:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652058.529794:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147656448 00000100:00100000:1.0:1788652058.529801:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147656448 00000100:00100000:1.0:1788652058.529841:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788652058.529849:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147656448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652058.529896:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147656448:12345-0@lo:400:kworker.0 Request processed in 47us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652058.529903:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788652058.529962:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147656064 00000100:00100000:1.0:1788652058.529965:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147656064 00000100:00100000:1.0:1788652058.529991:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788652058.529997:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:3637:x1875537147656064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652058.530025:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:3637:x1875537147656064:12345-0@lo:400:kworker.0 Request processed in 28us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652058.530031:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788652058.530067:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147656064:0@lo:400:kworker.0 00000100:00100000:1.0:1788652058.530078:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147656448:0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.530408:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147656192:0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.530441:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652058.530472:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147656960:0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.530493:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652058.530512:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788652058.530518:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147656320:0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.530540:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652058.530556:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147657088:0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.530577:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652058.530601:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147656832 00000100:00100000:2.0:1788652058.530605:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147656832 00000100:00100000:2.0:1788652058.530628:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147656960 00000100:00100000:2.0:1788652058.530631:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147656960 00000100:00100000:2.0:1788652058.530664:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147656320 00000100:00100000:2.0:1788652058.530667:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147656320 00000100:00100000:2.0:1788652058.530677:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147657088 00000100:00100000:2.0:1788652058.530680:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147657088 00000100:00100000:2.0:1788652058.530699:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788652058.530705:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147656832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.530746:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147656832:12345-0@lo:400:kworker.0 Request processed in 41us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652058.530752:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788652058.530765:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788652058.530771:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147656960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.530800:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff444700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147656960:12345-0@lo:400:kworker.0 Request processed in 30us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652058.530805:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788652058.530816:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788652058.530821:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147656320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.530845:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3635:x1875537147656320:12345-0@lo:400:kworker.0 Request processed in 25us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652058.530850:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788652058.530861:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652058.530866:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147657088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.530890:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147657088:12345-0@lo:400:kworker.0 Request processed in 24us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652058.530895:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788652058.530931:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147656192 00000100:00100000:2.0:1788652058.530934:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147656192 00000100:00100000:2.0:1788652058.530970:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788652058.530984:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147656192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.531013:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff447b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147656192:12345-0@lo:400:kworker.0 Request processed in 30us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652058.531018:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788652058.531040:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788652058.531044:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788652058.531070:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c368f800 x1875537147656320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652058.531080:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3635:1875537147656320:0@lo:400:kworker.0 00010000:00080000:2.0:1788652058.531089:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c368d180 x1875537147657088/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652058.531096:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147657088:0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.531104:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147656192:0@lo:400:kworker.0 00010000:00080000:2.0:1788652058.531112:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c368ca80 x1875537147656960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652058.531118:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147656960:0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.531140:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147656576:0@lo:8:kworker.0 00000100:00100000:2.0:1788652058.531250:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652058.531285:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147656704:0@lo:8:kworker.0 00000100:00100000:2.0:1788652058.531310:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788652058.531355:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c368c000 x1875537147656832/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652074 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652058.531364:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147656832:0@lo:400:kworker.0 00000100:00100000:2.0:1788652058.531414:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147656576 00000100:00100000:2.0:1788652058.531418:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147656576 00000100:00100000:2.0:1788652058.531433:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147656704 00000100:00100000:2.0:1788652058.531435:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147656704 00000100:00100000:2.0:1788652058.531444:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652058.531449:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1875537147656576:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788652058.531481:0:18693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:2.0:1788652058.531506:0:18693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c4fe9 00002000:00100000:2.0:1788652058.531521:0:18693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8f85c1973000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:2.0:1788652058.531525:0:18693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:2.0:1788652058.531527:0:18693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788652058.531707:0:18693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:2.0:1788652058.531731:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8f85c1977800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652058.531780:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3634:x1875537147656576:12345-0@lo:8:kworker.0 Request processed in 330us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652058.531787:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788652058.531800:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652058.531805:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1875537147656704:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788652058.531816:0:18693:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788652058.532783:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c368dc00 x1875537147656576/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652058.532795:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788652058.532803:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788652058.532812:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788652058.532817:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788652058.532820:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8f800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788652058.532840:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788652058.532845:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147656576:0@lo:8:kworker.0 00000004:00080000:1.0:1788652058.532978:0:17927:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788652058.532998:0:17927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17927:1875537147657344:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788652058.533044:0:17927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652058.533065:0:17927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc240 going to sleep for 11 seconds 00000004:00080000:1.0:1788652058.533080:0:17926:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788652058.533177:0:17926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 514468268300ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788652058.533184:0:17926:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:1.0:1788652058.533214:0:18692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788652058.533221:0:18692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788652058.533590:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652058.533602:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147657216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788652058.533633:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652058.533672:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147657344 00000100:00100000:1.0:1788652058.533677:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147657344 00000100:00100000:1.0:1788652058.533783:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788652058.533793:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17927:x1875537147657344:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788652058.534097:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147657216 00000100:00100000:0.0:1788652058.534102:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147657216 00000100:00100000:0.0:1788652058.534128:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652058.534135:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1875537147657216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788652058.534166:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788652058.534216:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3638:x1875537147657216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652058.534223:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788652058.534263:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c368c700 x1875537147657216/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652058.534279:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147657216:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788652058.534306:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788652058.536633:0:17918:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:0.0:1788652058.539858:0:19081:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788652058.539869:0:19081:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:0.0:1788652058.543443:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17927:x1875537147657344:12345-0@lo:7:osp-pre-0-1.0 Request processed in 9642us (10389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652058.543461:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788652058.552343:0:17927:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c368f100 x1875537147657344/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788652074 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652058.552364:0:17927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17927:1875537147657344:0@lo:7:osp-pre-0-1.0 00000004:00080000:1.0:1788652058.552383:0:17927:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:1.0:1788652058.552436:0:17927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17927:1875537147657472:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788652058.552492:0:17927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652058.552534:0:17927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788652058.553372:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147657472 00000100:00100000:0.0:1788652058.553381:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147657472 00000100:00100000:0.0:1788652058.553439:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788652058.553448:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17927:x1875537147657472:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788652058.553476:0:18692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:0.0:1788652058.553540:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17927:x1875537147657472:12345-0@lo:5:osp-pre-0-1.0 Request processed in 93us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652058.553548:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788652058.553627:0:17927:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c368f100 x1875537147657472/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788652074 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652058.553641:0:17927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17927:1875537147657472:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788652058.553652:0:17927:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788652058.553688:0:17927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17927:1875537147657600:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788652058.553717:0:17927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652058.553741:0:17927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bd9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788652058.553985:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147657600 00000100:00100000:0.0:1788652058.553990:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147657600 00000100:00100000:0.0:1788652058.554019:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788652058.554027:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17927:x1875537147657600:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788652058.554054:0:19081:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788652058.563992:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff445f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1875537147656704:12345-0@lo:8:kworker.0 Request processed in 32178us (32673us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788652058.564005:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788652058.564209:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652058.564215:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788652058.564219:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147656704:0@lo:8:kworker.0 00000001:00080000:1.0:1788652058.586184:0:18688:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788652058.586205:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1788652058.586566:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17927:x1875537147657600:12345-0@lo:5:osp-pre-0-1.0 Request processed in 32535us (32843us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788652058.586579:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788652058.588239:0:17927:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c3713100 x1875537147657600/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788652074 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652058.588254:0:17927:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788652058.588261:0:17927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17927:1875537147657600:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788652058.588279:0:17927:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788652058.588342:0:17927:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17927:1875537147657728:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788652058.588400:0:17927:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652058.588426:0:17927:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bd9600 going to sleep for 11 seconds 00000100:00100000:1.0:1788652058.589069:0:17198:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147657728 00000100:00100000:1.0:1788652058.589077:0:17198:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147657728 00000100:00100000:1.0:1788652058.589130:0:17198:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652058.589139:0:17198:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17927:x1875537147657728:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788652058.589223:0:17198:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:17927:x1875537147657728:12345-0@lo:900:osp-pre-0-1.0 Request processed in 86us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652058.589231:0:17198:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788652058.589368:0:17927:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c3713100 x1875537147657728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788652074 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652058.589380:0:17927:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17927:1875537147657728:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788652059.168396:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788652059.207139:0:19112:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652059.207704:0:19112:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788652059.617497:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652059.617539:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147657856:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788652059.617606:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652059.617674:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147657856 00000100:00100000:2.0:1788652059.617681:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147657856 00000100:00100000:2.0:1788652059.617733:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788652059.617743:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147657856:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788652059.617777:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788652059.617821:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff446a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147657856:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652059.617830:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788652059.617879:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147657856:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788652059.618572:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788652059.618584:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147657984:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652059.618623:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652059.618896:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147657984 00000100:00100000:3.0:1788652059.618902:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147657984 00000100:00100000:3.0:1788652059.619352:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788652059.619362:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147657984:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788652059.619403:0:18173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788652059.619466:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147657984:12345-0@lo:41:osp-pre-0-1.0 Request processed in 107us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652059.619473:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788652059.619550:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147657984:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788652059.872739:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788652060.199035:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788652060.347677:0:19162:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652060.347955:0:19162:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788652061.216509:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.240106:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652062.624993:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652042/real 1788652042] req@ffff8f86f48d2300 x1875537147646720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652062.625029:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86f48d2300 x1875537147646720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652062.625041:0:3634:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788652042/real 1788652042] req@ffff8f86f48d3480 x1875537147646848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652062 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652062.625052:0:3634:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8f86f48d3480 x1875537147646848/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788652062 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788652062.625070:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f3000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788652062.625096:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788652062.625100:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147646720:0@lo:8:kworker.0 00000100:00080000:3.0:1788652062.625117:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788652062.625123:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788652062.625126:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147646848:0@lo:8:kworker.0 00000100:00100000:2.0:1788652062.625485:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147658112:0@lo:400:kworker.0 00000100:00100000:2.0:1788652062.625554:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652062.625653:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147658112 00000100:00100000:3.0:1788652062.625663:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147658112 00000100:00100000:3.0:1788652062.625712:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788652062.625721:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:3636:x1875537147658112:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788652062.625802:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652062.625806:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788652062.625814:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f3000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652062.625818:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1788652062.625822:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788652062.625828:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8f86f67f3000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652062.625847:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86d109b100 x1875537147658368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788652062.625860:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652062.625864:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788652062.625866:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652062.625869:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 498 00000100:00080000:0.0:1788652062.625879:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788652062.625884:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f85c373a800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652062.625894:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86d1099c00 x1875537147658496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652062.633342:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:3636:x1875537147658112:12345-0@lo:400:kworker.0 Request processed in 7599us (7765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652062.633357:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788652062.633437:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147658368:0@lo:8:kworker.0 00000100:00100000:3.0:1788652062.633499:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652062.633540:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147658496:0@lo:8:kworker.0 00000100:00100000:3.0:1788652062.633590:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652062.633646:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147658368 00000100:00100000:3.0:1788652062.633655:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147658368 00000100:00100000:3.0:1788652062.633682:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147658496 00000100:00100000:3.0:1788652062.633686:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147658496 00000100:00100000:3.0:1788652062.633710:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788652062.633717:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875537147658368:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788652062.633750:0:18694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:3.0:1788652062.633782:0:18694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c4ff0 00002000:00100000:3.0:1788652062.633796:0:18694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8f86c4e78000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788652062.633800:0:18694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788652062.633802:0:18694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788652062.633901:0:18694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788652062.633952:0:18694:0:(import.c:65:import_set_state_nolock()) ffff8f86c4e7d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652062.634005:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3634:x1875537147658368:12345-0@lo:8:kworker.0 Request processed in 286us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652062.634012:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788652062.634028:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788652062.634032:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875537147658496:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788652062.634043:0:18694:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788652062.634068:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875537147658496:12345-0@lo:8:kworker.0 Request processed in 35us (478us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788652062.634074:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788652062.634113:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86d109b100 x1875537147658368/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652062.634123:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788652062.634132:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788652062.634141:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788652062.634147:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788652062.634149:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86f67f3000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788652062.634171:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788652062.634177:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147658368:0@lo:8:kworker.0 00000100:00080000:3.0:1788652062.634189:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788652062.634193:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788652062.634196:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147658496:0@lo:8:kworker.0 00000004:00080000:3.0:1788652062.634243:0:17211:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788652062.634259:0:17211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17211:1875537147659008:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788652062.634293:0:17211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652062.634309:0:17211:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2bd9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652062.634320:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147659008 00000100:00100000:3.0:1788652062.634323:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147659008 00000100:00100000:3.0:1788652062.634358:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652062.634365:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17211:x1875537147659008:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788652062.634592:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652062.635805:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788652062.635811:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788652062.635814:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788652062.635820:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 514 00000100:00080000:0.0:1788652062.635825:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788652062.635832:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f86c6e8e000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652062.635855:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86d1099f80 x1875537147659264/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788652062.635958:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147658624:0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.636013:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652062.636055:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147659392:0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.636078:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652062.636100:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788652062.636107:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147658240:0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.636131:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652062.636149:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147659136:0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.636169:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652062.636200:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147659136 00000100:00100000:0.0:1788652062.636207:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147659136 00000100:00100000:0.0:1788652062.636264:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788652062.636272:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147659136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.636317:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147659136:12345-0@lo:400:kworker.0 Request processed in 46us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652062.636324:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788652062.638453:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86d109aa00 x1875537147659136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788652078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652062.638471:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147659136:0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.638506:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147659264:0@lo:8:kworker.0 00000100:00100000:0.0:1788652062.638572:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652062.638624:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147659264 00000100:00100000:0.0:1788652062.638643:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147659264 00000100:00100000:0.0:1788652062.638674:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652062.638682:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875537147659264:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788652062.638712:0:18692:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788652062.638757:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3634:x1875537147659264:12345-0@lo:8:kworker.0 Request processed in 75us (185us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788652062.638782:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788652062.638809:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788652062.638813:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788652062.638817:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147659264:0@lo:8:kworker.0 00000100:00080000:3.0:1788652062.639882:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652062.640450:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147658752:0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.640515:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652062.640550:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147659520:0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.640580:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652062.640609:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788652062.640616:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147658880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788652062.641094:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147658624 00000100:00100000:3.0:1788652062.641103:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147658624 00000100:00100000:3.0:1788652062.641140:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147659392 00000100:00100000:3.0:1788652062.641143:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147659392 00000100:00100000:3.0:1788652062.641157:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147659520 00000100:00100000:3.0:1788652062.641159:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147659520 00000100:00100000:3.0:1788652062.641183:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788652062.641191:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147658624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.641315:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652062.641411:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147659648:0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.641443:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652062.641468:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147658240 00000100:00100000:0.0:1788652062.641472:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147658240 00000100:00100000:0.0:1788652062.641502:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147658752 00000100:00100000:0.0:1788652062.641504:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147658752 00000100:00100000:0.0:1788652062.641518:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788652062.641523:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147658240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.641576:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147658240:12345-0@lo:400:kworker.0 Request processed in 52us (5444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652062.641583:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788652062.641601:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788652062.641608:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147658752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652062.646360:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147658112:0@lo:400:kworker.0 00000004:00080000:2.0:1788652062.646424:0:17210:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788652062.646524:0:17210:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 518581616074ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788652062.646532:0:17210:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788652062.646587:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788652062.646597:0:17187:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788652062.646617:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788652062.646624:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147659648 00000100:00100000:2.0:1788652062.646633:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147659648 00000100:00100000:2.0:1788652062.646674:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788652062.646684:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652062.646694:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147659392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652062.646786:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147659392:12345-0@lo:400:kworker.0 Request processed in 93us (10706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652062.646804:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788652062.646822:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788652062.646827:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788652062.646833:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147659520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652062.646868:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147659520:12345-0@lo:400:kworker.0 Request processed in 35us (6287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652062.646884:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788652062.646896:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788652062.646903:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788652062.646937:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147658624:12345-0@lo:400:kworker.0 Request processed in 5744us (10920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652062.646938:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147659648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652062.646953:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788652062.646982:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147659648:12345-0@lo:400:kworker.0 Request processed in 47us (5537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652062.646990:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1788652062.646992:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788652062.646998:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:3.0:1788652062.647011:0:18694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788652062.647019:0:18694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788652062.647025:0:18694:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00000100:00100000:2.0:1788652062.649485:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147658240:0@lo:400:kworker.0 00010000:00080000:2.0:1788652062.649511:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86d109b480 x1875537147658624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652062.649523:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147658624:0@lo:400:kworker.0 00010000:00080000:2.0:1788652062.649535:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86d109ad80 x1875537147659392/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652062.649544:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147659392:0@lo:400:kworker.0 00000100:00100000:2.0:1788652062.649596:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147658880 00000100:00100000:2.0:1788652062.649603:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147658880 00000100:00100000:2.0:1788652062.649657:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788652062.649665:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875537147658880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652062.649706:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788652062.649776:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3635:x1875537147658880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (8459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652062.649783:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788652062.649994:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147658752:12345-0@lo:400:kworker.0 Request processed in 8385us (9477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652062.650011:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1788652062.650055:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c3712d80 x1875537147658880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652062.650073:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147658880:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788652062.650089:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86d109b100 x1875537147659648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652062.650096:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147659648:0@lo:400:kworker.0 00000100:00100000:0.0:1788652062.650108:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147658752:0@lo:400:kworker.0 00010000:00080000:0.0:1788652062.650119:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86d1099c00 x1875537147659520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652062.650128:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147659520:0@lo:400:kworker.0 00000004:00080000:2.0:1788652062.656560:0:17167:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788652062.661323:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652062.662308:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c4ff7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.662437:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788652062.662450:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652062.662458:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c4ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.662478:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c4ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.662490:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c4ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.662496:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c4ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.662518:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652062.662532:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652062.662538:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c4ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.662546:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652062.662551:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c4ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.662560:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c4ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.662575:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c4ff7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.662596:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c4ff7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.662616:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.662618:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.662620:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652062.667976:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652062.668000:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c4ffe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.668024:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788652062.668029:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652062.668042:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c4ffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.668066:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c4ffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.668078:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c4ffe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.668086:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c4ffe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.668129:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788652062.671456:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.671472:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5005 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.671507:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.671512:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.671519:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5005 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.671535:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5005 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.671566:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5005 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.671574:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5005 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.671666:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788652062.672516:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.672526:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c500c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.672537:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.672541:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.672545:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c500c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.672557:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c500c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.672566:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c500c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.672573:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c500c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.672599:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788652062.673076:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788652062.673086:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c4ffe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.673095:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652062.673101:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c4ffe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.673111:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c4ffe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.673131:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c4ffe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.673138:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c4ffe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.673161:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788652062.673165:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5005 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.673180:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652062.673183:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5005 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652062.674011:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.674021:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cdcf3d6/0xcd2f56ea038c5013 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.674031:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.674035:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.674040:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cdcf3d6/0xcd2f56ea038c5013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.674051:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cdcf3d6/0xcd2f56ea038c5013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.674059:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cdcf3d6/0xcd2f56ea038c5013 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.674067:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cdcf3d6/0xcd2f56ea038c5013 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.674077:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788652062.674427:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788652062.674658:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5005 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.674674:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5005 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.674682:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011977d76/0xcd2f56ea038c5005 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.674704:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652062.674708:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cdcf3d6/0xcd2f56ea038c5013 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.674715:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652062.674719:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cdcf3d6/0xcd2f56ea038c5013 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.674727:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cdcf3d6/0xcd2f56ea038c5013 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.674736:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cdcf3d6/0xcd2f56ea038c5013 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.674756:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cdcf3d6/0xcd2f56ea038c5013 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.674769:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.674771:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.674773:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652062.675550:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.675561:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000becb64df/0xcd2f56ea038c501a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.675575:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.675586:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.675592:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000becb64df/0xcd2f56ea038c501a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.675603:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000becb64df/0xcd2f56ea038c501a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.675613:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000becb64df/0xcd2f56ea038c501a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.675620:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000becb64df/0xcd2f56ea038c501a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.675649:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652062.675987:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652062.675993:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000becb64df/0xcd2f56ea038c501a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.676001:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652062.676005:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000becb64df/0xcd2f56ea038c501a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.676014:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000becb64df/0xcd2f56ea038c501a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.676027:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000becb64df/0xcd2f56ea038c501a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.676035:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000becb64df/0xcd2f56ea038c501a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.676057:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c500c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.676076:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652062.676079:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c500c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.676087:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c500c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.676098:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c500c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.676105:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c500c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.676117:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.676119:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.676122:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.676128:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.676129:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.676131:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.676203:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652062.678558:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.678572:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee6a0850/0xcd2f56ea038c5021 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.678592:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.678596:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.678604:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee6a0850/0xcd2f56ea038c5021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.678622:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee6a0850/0xcd2f56ea038c5021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.678634:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee6a0850/0xcd2f56ea038c5021 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.678652:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee6a0850/0xcd2f56ea038c5021 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.678677:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652062.679594:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652062.679604:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee6a0850/0xcd2f56ea038c5021 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.679614:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652062.679619:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee6a0850/0xcd2f56ea038c5021 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.679642:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee6a0850/0xcd2f56ea038c5021 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.679660:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee6a0850/0xcd2f56ea038c5021 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.679667:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee6a0850/0xcd2f56ea038c5021 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.679687:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.679689:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.679691:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652062.679797:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.679803:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d7ee5d5/0xcd2f56ea038c5028 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.679813:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.679816:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.679821:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d7ee5d5/0xcd2f56ea038c5028 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.679832:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d7ee5d5/0xcd2f56ea038c5028 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.679841:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d7ee5d5/0xcd2f56ea038c5028 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.679849:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d7ee5d5/0xcd2f56ea038c5028 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.679884:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652062.680425:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652062.680432:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d7ee5d5/0xcd2f56ea038c5028 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.680439:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652062.680442:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d7ee5d5/0xcd2f56ea038c5028 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.680450:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d7ee5d5/0xcd2f56ea038c5028 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.680462:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d7ee5d5/0xcd2f56ea038c5028 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.680482:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d7ee5d5/0xcd2f56ea038c5028 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.680501:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.680503:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.680506:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652062.681107:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.681115:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe1d941c/0xcd2f56ea038c502f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.681133:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.681136:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.681142:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1d941c/0xcd2f56ea038c502f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.681153:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe1d941c/0xcd2f56ea038c502f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.681161:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fe1d941c/0xcd2f56ea038c502f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.681169:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fe1d941c/0xcd2f56ea038c502f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.681200:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652062.681891:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652062.681904:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fe1d941c/0xcd2f56ea038c502f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.681944:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652062.681948:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe1d941c/0xcd2f56ea038c502f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.681958:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fe1d941c/0xcd2f56ea038c502f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.681975:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fe1d941c/0xcd2f56ea038c502f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.681982:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe1d941c/0xcd2f56ea038c502f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.681998:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.682000:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.682002:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652062.683844:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.683859:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aef1eb6/0xcd2f56ea038c5036 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.683884:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.683889:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.683895:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aef1eb6/0xcd2f56ea038c5036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.683938:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aef1eb6/0xcd2f56ea038c5036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.683964:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003aef1eb6/0xcd2f56ea038c5036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.683972:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003aef1eb6/0xcd2f56ea038c5036 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.683994:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788652062.684992:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652062.685002:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003aef1eb6/0xcd2f56ea038c5036 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.685012:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652062.685017:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003aef1eb6/0xcd2f56ea038c5036 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.685028:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003aef1eb6/0xcd2f56ea038c5036 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.685050:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003aef1eb6/0xcd2f56ea038c5036 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.685059:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aef1eb6/0xcd2f56ea038c5036 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.685088:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.685090:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.685092:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652062.691557:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652062.691573:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c503d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.691591:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788652062.691596:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652062.691602:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c503d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.691637:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c503d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.691649:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c503d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.691657:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c503d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.691681:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652062.691960:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652062.691967:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c503d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.691988:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652062.691993:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c503d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.692003:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c503d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.692025:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c503d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.692033:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000028366e39/0xcd2f56ea038c503d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.692060:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.692063:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.692064:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652062.694863:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652062.694888:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5044 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.694905:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788652062.694942:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652062.694950:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.694966:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.694977:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5044 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.694985:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.695012:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652062.695332:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652062.695340:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.695349:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652062.695353:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.695364:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5044 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.695383:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5044 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.695390:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afcdb249/0xcd2f56ea038c5044 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.695409:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652062.695417:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652062.695419:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652062.699317:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652062.702287:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c504b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.702336:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=518s v=(0 0) 00010000:00010000:2.0:1788652062.702342:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652062.702349:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c504b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.702365:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c504b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.702376:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c504b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.702385:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c504b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.702421:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652062.707705:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652062.707722:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c504b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.707737:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652062.707742:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c504b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.707754:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c504b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.707776:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c504b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.707784:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d61336d7/0xcd2f56ea038c504b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.707809:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652062.707811:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652062.707813:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652062.709860:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.709884:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec953f4d/0xcd2f56ea038c5052 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.709901:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.709926:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.709941:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec953f4d/0xcd2f56ea038c5052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.709957:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec953f4d/0xcd2f56ea038c5052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.709969:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec953f4d/0xcd2f56ea038c5052 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.709978:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec953f4d/0xcd2f56ea038c5052 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.709996:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652062.712468:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652062.712483:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec953f4d/0xcd2f56ea038c5052 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.712496:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652062.712502:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec953f4d/0xcd2f56ea038c5052 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.712513:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec953f4d/0xcd2f56ea038c5052 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.712549:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec953f4d/0xcd2f56ea038c5052 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.712557:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec953f4d/0xcd2f56ea038c5052 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.712577:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.712579:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.712581:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652062.712849:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.712858:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a751466/0xcd2f56ea038c5059 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.712869:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.712883:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.712890:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a751466/0xcd2f56ea038c5059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.712903:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a751466/0xcd2f56ea038c5059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.712937:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a751466/0xcd2f56ea038c5059 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.712959:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a751466/0xcd2f56ea038c5059 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.712987:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788652062.713510:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.713517:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000532d6dc8/0xcd2f56ea038c5060 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.713527:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.713530:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.713534:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000532d6dc8/0xcd2f56ea038c5060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.713542:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000532d6dc8/0xcd2f56ea038c5060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.713549:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000532d6dc8/0xcd2f56ea038c5060 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.713556:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000532d6dc8/0xcd2f56ea038c5060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.713579:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788652062.713949:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.713955:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907da683/0xcd2f56ea038c5067 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.713970:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.713973:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.713978:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000907da683/0xcd2f56ea038c5067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.713987:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000907da683/0xcd2f56ea038c5067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.713995:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000907da683/0xcd2f56ea038c5067 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714002:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000907da683/0xcd2f56ea038c5067 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714018:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788652062.714028:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788652062.714034:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a751466/0xcd2f56ea038c5059 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714042:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652062.714047:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a751466/0xcd2f56ea038c5059 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714054:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a751466/0xcd2f56ea038c5059 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714078:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a751466/0xcd2f56ea038c5059 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714086:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a751466/0xcd2f56ea038c5059 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714101:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652062.714104:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000532d6dc8/0xcd2f56ea038c5060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714111:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5600 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652062.714114:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000532d6dc8/0xcd2f56ea038c5060 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714121:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000532d6dc8/0xcd2f56ea038c5060 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714130:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000532d6dc8/0xcd2f56ea038c5060 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714137:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000532d6dc8/0xcd2f56ea038c5060 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714148:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652062.714151:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000907da683/0xcd2f56ea038c5067 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714163:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652062.714166:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000907da683/0xcd2f56ea038c5067 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714173:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000907da683/0xcd2f56ea038c5067 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714184:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000907da683/0xcd2f56ea038c5067 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714396:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000907da683/0xcd2f56ea038c5067 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714413:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652062.714414:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652062.714416:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.714750:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652062.714845:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.714852:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000702c4760/0xcd2f56ea038c506e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714861:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.714865:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.714879:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000702c4760/0xcd2f56ea038c506e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.714890:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000702c4760/0xcd2f56ea038c506e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.715020:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652062.715270:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000702c4760/0xcd2f56ea038c506e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.715280:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000702c4760/0xcd2f56ea038c506e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.716772:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788652062.718302:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788652062.718314:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b980c3/0xcd2f56ea038c5075 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.718386:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=518s v=(0 0) 00010000:00010000:1.0:1788652062.718391:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788652062.718397:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072b980c3/0xcd2f56ea038c5075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.718414:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072b980c3/0xcd2f56ea038c5075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.718425:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072b980c3/0xcd2f56ea038c5075 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.718432:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072b980c3/0xcd2f56ea038c5075 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.718526:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652062.718535:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000702c4760/0xcd2f56ea038c506e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.718544:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652062.718549:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000702c4760/0xcd2f56ea038c506e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.718558:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000702c4760/0xcd2f56ea038c506e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.718576:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000702c4760/0xcd2f56ea038c506e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.718583:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000702c4760/0xcd2f56ea038c506e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.718615:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652062.718618:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072b980c3/0xcd2f56ea038c5075 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.718624:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f8c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652062.718627:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b980c3/0xcd2f56ea038c5075 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.718730:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788652062.719119:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072b980c3/0xcd2f56ea038c5075 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.719135:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072b980c3/0xcd2f56ea038c5075 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.719143:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072b980c3/0xcd2f56ea038c5075 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.719160:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.719162:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788652062.719357:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652062.719364:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b08f260/0xcd2f56ea038c507c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.719374:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=518s v=(0 0) 00010000:00010000:0.0:1788652062.719378:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652062.719382:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b08f260/0xcd2f56ea038c507c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.719394:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b08f260/0xcd2f56ea038c507c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.719402:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b08f260/0xcd2f56ea038c507c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652062.719409:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b08f260/0xcd2f56ea038c507c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.719482:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788652062.719488:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b08f260/0xcd2f56ea038c507c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.719496:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652062.719500:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b08f260/0xcd2f56ea038c507c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.719508:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b08f260/0xcd2f56ea038c507c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.719518:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b08f260/0xcd2f56ea038c507c lrc: 2/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.719526:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.719528:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.719529:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.719736:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652062.720289:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788652062.720297:0:18694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b08f260/0xcd2f56ea038c507c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.720520:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652062.725042:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652062.725056:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c5083 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.725074:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788652062.725078:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652062.725085:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c5083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.725114:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c5083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.725126:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c5083 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.725134:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c5083 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.725260:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788652062.729614:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652062.729629:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057fd5285/0xcd2f56ea038c508a lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.729648:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788652062.729653:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652062.729659:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057fd5285/0xcd2f56ea038c508a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.729673:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057fd5285/0xcd2f56ea038c508a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.729685:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057fd5285/0xcd2f56ea038c508a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.729705:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057fd5285/0xcd2f56ea038c508a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.729960:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652062.729968:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c5083 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.729977:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652062.729982:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c5083 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.730004:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c5083 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.730022:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c5083 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.730030:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002934874d/0xcd2f56ea038c5083 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.730049:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652062.730051:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057fd5285/0xcd2f56ea038c508a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.730058:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652062.730061:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057fd5285/0xcd2f56ea038c508a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.730068:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057fd5285/0xcd2f56ea038c508a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.730078:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057fd5285/0xcd2f56ea038c508a lrc: 2/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.730086:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652062.730087:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652062.730095:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652062.731104:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788652062.731113:0:18694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057fd5285/0xcd2f56ea038c508a lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788652062.731731:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652062.731738:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee4bf43c/0xcd2f56ea038c5091 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.731750:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788652062.731754:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652062.731759:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee4bf43c/0xcd2f56ea038c5091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.731771:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee4bf43c/0xcd2f56ea038c5091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.731780:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee4bf43c/0xcd2f56ea038c5091 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.731788:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee4bf43c/0xcd2f56ea038c5091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.731823:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788652062.732161:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652062.732169:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee4bf43c/0xcd2f56ea038c5091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.732178:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652062.732182:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee4bf43c/0xcd2f56ea038c5091 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.732200:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee4bf43c/0xcd2f56ea038c5091 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.732216:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee4bf43c/0xcd2f56ea038c5091 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.732224:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee4bf43c/0xcd2f56ea038c5091 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.732241:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652062.732243:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652062.732245:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652062.732442:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652062.732448:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a657e8/0xcd2f56ea038c5098 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.732457:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788652062.732461:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652062.732465:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044a657e8/0xcd2f56ea038c5098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.732475:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044a657e8/0xcd2f56ea038c5098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.732483:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044a657e8/0xcd2f56ea038c5098 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.732490:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044a657e8/0xcd2f56ea038c5098 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.732511:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788652062.732826:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652062.732833:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065835a49/0xcd2f56ea038c509f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.732841:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788652062.732851:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652062.732856:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000065835a49/0xcd2f56ea038c509f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.732867:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000065835a49/0xcd2f56ea038c509f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.732886:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000065835a49/0xcd2f56ea038c509f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.732893:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000065835a49/0xcd2f56ea038c509f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.732929:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788652062.733284:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652062.733290:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044a657e8/0xcd2f56ea038c5098 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.733298:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652062.733302:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044a657e8/0xcd2f56ea038c5098 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.733322:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044a657e8/0xcd2f56ea038c5098 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.733518:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044a657e8/0xcd2f56ea038c5098 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.733525:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044a657e8/0xcd2f56ea038c5098 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.733542:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652062.733546:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000065835a49/0xcd2f56ea038c509f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.733553:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652062.733556:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000065835a49/0xcd2f56ea038c509f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.733564:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000065835a49/0xcd2f56ea038c509f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.733574:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000065835a49/0xcd2f56ea038c509f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.733581:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000065835a49/0xcd2f56ea038c509f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.733607:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652062.733609:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652062.733611:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652062.733617:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652062.733858:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652062.733865:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007ae5f41/0xcd2f56ea038c50a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.733882:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788652062.733886:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652062.733891:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007ae5f41/0xcd2f56ea038c50a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.733900:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007ae5f41/0xcd2f56ea038c50a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.733935:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007ae5f41/0xcd2f56ea038c50a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.733950:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007ae5f41/0xcd2f56ea038c50a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.733966:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652062.734351:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652062.734358:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007ae5f41/0xcd2f56ea038c50a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.734366:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652062.734375:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007ae5f41/0xcd2f56ea038c50a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.734384:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007ae5f41/0xcd2f56ea038c50a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.734396:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007ae5f41/0xcd2f56ea038c50a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.734402:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007ae5f41/0xcd2f56ea038c50a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652062.734416:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.734418:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.734419:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652062.734556:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652062.734562:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011deceff/0xcd2f56ea038c50ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.734570:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788652062.734573:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652062.734577:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011deceff/0xcd2f56ea038c50ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.734585:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011deceff/0xcd2f56ea038c50ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.734593:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011deceff/0xcd2f56ea038c50ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.734600:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011deceff/0xcd2f56ea038c50ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.734624:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788652062.734925:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652062.734932:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011deceff/0xcd2f56ea038c50ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.734939:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652062.734942:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011deceff/0xcd2f56ea038c50ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.734949:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011deceff/0xcd2f56ea038c50ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.734962:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011deceff/0xcd2f56ea038c50ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.734969:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011deceff/0xcd2f56ea038c50ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.734983:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652062.734985:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652062.734987:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652062.735068:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652062.735074:0:18694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c50b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.735087:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=518s v=(0 0) 00010000:00010000:3.0:1788652062.735090:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652062.735095:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c50b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.735104:0:18694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c50b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.735113:0:18694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c50b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.735120:0:18694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c50b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652062.735220:0:18694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788652062.735255:0:18694:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788652062.735370:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17211:x1875537147659008:12345-0@lo:5:osp-pre-0-0.0 Request processed in 101001us (101071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652062.735380:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788652062.735435:0:17211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17211:1875537147659008:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788652062.735452:0:17211:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788652062.735508:0:17211:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17211:1875537147659776:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788652062.735548:0:17211:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652062.735576:0:17211:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652062.735605:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147659776 00000100:00100000:3.0:1788652062.735612:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147659776 00000100:00100000:3.0:1788652062.735672:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788652062.735684:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17211:x1875537147659776:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788652062.735725:0:18692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00010000:00010000:1.0:1788652062.738290:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652062.738303:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c50b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.738323:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652062.738398:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c50b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.738409:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c50b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.738428:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c50b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.738437:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c1e24bf/0xcd2f56ea038c50b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652062.738461:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652062.738463:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652062.738465:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652062.743047:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788652062.752471:0:18688:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:3.0:1788652062.752512:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788652062.752833:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17211:x1875537147659776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17146us (17279us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788652062.752855:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788652062.753030:0:17211:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:3.0:1788652062.753039:0:17211:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17211:1875537147659776:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788652062.753057:0:17211:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1788652063.264451:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652063.713100:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147659904:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788652063.713193:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652063.713482:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147659904 00000100:00100000:0.0:1788652063.713491:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147659904 00000100:00100000:0.0:1788652063.713554:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788652063.713564:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147659904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788652063.713592:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788652063.713643:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147659904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 80us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652063.713652:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788652063.713743:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147659904:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788652064.290555:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652064.737379:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147660032:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652064.737449:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652064.737897:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147660160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652064.738391:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147660032 00000100:00100000:3.0:1788652064.738402:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147660032 00000100:00100000:3.0:1788652064.738450:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788652064.738460:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147660032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788652064.738494:0:18173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788652064.738667:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652064.738755:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147660160 00000100:00100000:1.0:1788652064.738759:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147660160 00000100:00100000:1.0:1788652064.738791:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788652064.738798:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147660160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788652064.738817:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788652064.739040:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147660160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 242us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652064.739057:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788652064.739407:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147660160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788652064.740712:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147660032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788652064.741228:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147660032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652064.741241:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1788652065.314080:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788652065.637239:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788652066.337864:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652067.364752:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788652067.413458:0:19509:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788652067.413463:0:19509:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788652067.413464:0:19509:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788652067.416919:0:19509:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8f86f3cfe800 00000020:01000004:3.0:1788652067.416958:0:19509:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788652067.416974:0:19509:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788652067.417011:0:19509:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8f85c217cd40) 00000020:00000080:3.0:1788652067.417032:0:19509:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788652067.475471:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788652067.478894:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788652067.479225:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788652067.479734:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788652067.480214:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1788652067.480409:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788652067.480658:0:19509:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1788652067.481879:0:19509:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788652067.482262:0:19509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788652067.482276:0:19509:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788652067.482289:0:19509:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd2f56ea038c50c2 00000020:01000004:2.0:1788652067.482296:0:19509:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1788652067.482325:0:19509:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.145@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788652067.482329:0:19509:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.145@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788652067.482335:0:19509:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788652067.482364:0:19509:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1788652067.482368:0:19509:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.145@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788652067.490570:0:19509:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.145@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788652067.490698:0:19509:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.145@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788652067.490702:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788652067.490704:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788652067.490705:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652067.490706:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652067.490707:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652067.490708:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652067.490709:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652067.490711:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652067.490712:0:19509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788652067.490715:0:19509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788652067.490717:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788652067.490718:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788652067.490719:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652067.490720:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652067.490721:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652067.490722:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652067.490723:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652067.490724:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652067.490725:0:19509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788652067.490751:0:19509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788652067.490770:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660288:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788652067.490858:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.490999:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ee240 going to sleep for 11 seconds 00000100:00100000:1.0:1788652067.491043:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147660288 00000100:00100000:1.0:1788652067.491051:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147660288 00000100:00100000:1.0:1788652067.491160:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788652067.491170:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:19509:x1875537147660288:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788652067.491200:0:17182:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788652067.491204:0:17182:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788652067.491207:0:17182:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788652067.491523:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:19509:x1875537147660288:12345-0@lo:253:mount.lustre.0 Request processed in 354us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652067.491532:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788652067.491668:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660288:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788652067.491677:0:19509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788652067.491679:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788652067.491680:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788652067.491681:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652067.491682:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652067.491683:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652067.491684:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652067.491685:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652067.491688:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652067.491689:0:19509:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788652067.491707:0:19509:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8f86f3cfe800 from lustre-OST0001 10000000:01000000:2.0:1788652067.491740:0:19509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788652067.491743:0:19509:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788652067.491750:0:19509:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8f85c2ae4d40 local copy 00010000:00010000:2.0:1788652067.491759:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652067.491841:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660416:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788652067.491869:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.491977:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ee780 going to sleep for 11 seconds 00000100:00100000:3.0:1788652067.492039:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147660416 00000100:00100000:3.0:1788652067.492045:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147660416 00000100:00100000:3.0:1788652067.492156:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788652067.492165:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:19509:x1875537147660416:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652067.492280:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:19509:x1875537147660416:12345-0@lo:501:mount.lustre.0 Request processed in 116us (409us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788652067.492287:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788652067.492357:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660416:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788652067.492370:0:19509:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.145@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788652067.492403:0:19509:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.145@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788652067.492409:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652067.492418:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c35c6000/0xcd2f56ea038c4d11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c4d18 expref: -99 pid: 17166 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788652067.492449:0:19509:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8f86f3cfe800 10000000:01000000:0.0:1788652067.492453:0:19509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788652067.492458:0:19509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788652067.492460:0:19509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788652067.492463:0:19509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788652067.492466:0:19509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788652067.492487:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652067.492494:0:19509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652067.492501:0:19509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652067.492515:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660544:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788652067.492542:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652067.492564:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0e88540 going to sleep for 11 seconds 00000100:00100000:1.0:1788652067.492674:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147660544 00000100:00100000:1.0:1788652067.492679:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147660544 00000100:00100000:1.0:1788652067.492741:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788652067.492748:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:19509:x1875537147660544:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652067.492757:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652067.492768:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c50d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c50c9 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652067.492798:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c50d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c50c9 expref: 22 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652067.492808:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f8c00/0xcd2f56ea038c50d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c50c9 expref: 22 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652067.492816:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f8c00, rc 0) 00000100:00100000:1.0:1788652067.492858:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:19509:x1875537147660544:12345-0@lo:101:mount.lustre.0 Request processed in 111us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652067.492871:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788652067.492961:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660544:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788652067.492973:0:19509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652067.492981:0:19509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652067.493941:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788652067.494765:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652067.506937:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788652067.507009:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788652067.507024:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788652067.507036:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788652067.507048:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788652067.507059:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788652067.507086:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788652067.507102:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788652067.507206:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660672:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788652067.507891:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652067.508047:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0e88b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788652067.514061:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147660672 00000100:00100000:1.0:1788652067.514865:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147660672 00000100:00100000:1.0:1788652067.515734:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788652067.515749:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:19509:x1875537147660672:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652067.516953:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:19509:x1875537147660672:12345-0@lo:501:mount.lustre.0 Request processed in 1204us (9059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652067.516964:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788652067.524231:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660672:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652067.525544:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660800:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652067.525696:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652067.526239:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000600 going to sleep for 11 seconds 00000100:00100000:2.0:1788652067.530500:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147660800 00000100:00100000:2.0:1788652067.530516:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147660800 00000100:00100000:3.0:1788652067.530689:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788652067.530701:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:19509:x1875537147660800:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652067.531821:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:19509:x1875537147660800:12345-0@lo:503:mount.lustre.0 Request processed in 1119us (6121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.531833:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788652067.531961:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660800:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788652067.532465:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788652067.532563:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660928:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652067.532631:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652067.532671:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c6000240 going to sleep for 11 seconds 00000100:00100000:3.0:1788652067.533195:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147660928 00000100:00100000:3.0:1788652067.533202:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147660928 00000100:00100000:3.0:1788652067.533249:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788652067.533259:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:19509:x1875537147660928:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652067.533686:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:19509:x1875537147660928:12345-0@lo:502:mount.lustre.0 Request processed in 428us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.533694:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788652067.534678:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147660928:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652067.535005:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788652067.535041:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788652067.535058:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788652067.535071:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788652067.535085:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788652067.538468:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788652067.538494:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788652067.538509:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788652067.538521:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788652067.538574:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661056:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652067.538802:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.538851:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85eea80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652067.539879:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147661056 00000100:00100000:3.0:1788652067.539890:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147661056 00000100:00100000:3.0:1788652067.539970:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788652067.539981:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:19509:x1875537147661056:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652067.540138:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:19509:x1875537147661056:12345-0@lo:502:mount.lustre.0 Request processed in 159us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.540147:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788652067.540371:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661056:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652067.540441:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1788652067.540453:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788652067.541889:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788652067.541898:0:19513:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788652067.541924:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652067.541926:0:19513:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788652067.541934:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788652067.541949:0:19513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8f85c20fb380) 00000020:00000080:1.0:1788652067.541974:0:19513:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788652067.541980:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788652067.542044:0:19513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86f3cfe800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788652067.542053:0:19513:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788652067.542060:0:19513:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xcd2f56ea038c50de 00010000:00010000:1.0:1788652067.549845:0:19513:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788652067.551531:0:19513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788652067.555700:0:19513:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:1.0:1788652067.558361:0:19513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788652067.558374:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652067.558380:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652067.558382:0:19513:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788652067.558386:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652067.558395:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652067.558397:0:19513:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788652067.558400:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788652067.558402:0:19513:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788652067.558404:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652067.558407:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652067.558408:0:19513:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788652067.558415:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788652067.558418:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652067.558419:0:19513:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788652067.558426:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788652067.558458:0:19513:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788652067.558462:0:19513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788652067.558463:0:19513:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788652067.558466:0:19513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788652067.560131:0:19509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788652067.560194:0:19509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788652067.560225:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.560237:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da4000/0xcd2f56ea038c50c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c50d0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652067.560251:0:19509:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86f3cfe800 from 1 10000000:01000000:3.0:1788652067.560254:0:19509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788652067.560299:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.560309:0:19509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.560319:0:19509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652067.560349:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788652067.560435:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652067.560479:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f096bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788652067.560775:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147661184 00000100:00100000:1.0:1788652067.560792:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147661184 00000100:00100000:1.0:1788652067.560839:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788652067.560848:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:19509:x1875537147661184:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652067.560860:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652067.560873:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f9000/0xcd2f56ea038c50ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c50e5 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652067.560896:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f9000/0xcd2f56ea038c50ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c50e5 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652067.560933:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f9000/0xcd2f56ea038c50ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c50e5 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652067.560944:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9000, rc 0) 00000100:00100000:1.0:1788652067.560988:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:19509:x1875537147661184:12345-0@lo:101:mount.lustre.0 Request processed in 141us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652067.560994:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788652067.561791:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661184:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788652067.561812:0:19509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.561822:0:19509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788652067.564098:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788652067.564385:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788652067.564598:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788652067.564624:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788652067.564645:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788652067.564650:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788652067.564717:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652067.564790:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652067.564831:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2b23540 going to sleep for 11 seconds 00000100:00100000:1.0:1788652067.566710:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147661312 00000100:00100000:1.0:1788652067.566720:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147661312 00000100:00100000:1.0:1788652067.566769:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788652067.566786:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:19509:x1875537147661312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652067.566931:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:19509:x1875537147661312:12345-0@lo:501:mount.lustre.0 Request processed in 154us (2151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652067.566939:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788652067.568033:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652067.568086:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652067.568149:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652067.568178:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2b23540 going to sleep for 11 seconds 00000100:00100000:1.0:1788652067.568288:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147661440 00000100:00100000:1.0:1788652067.568294:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147661440 00000100:00100000:1.0:1788652067.568325:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788652067.568332:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:19509:x1875537147661440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652067.568435:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:19509:x1875537147661440:12345-0@lo:503:mount.lustre.0 Request processed in 102us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652067.568442:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788652067.568555:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661440:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788652067.569006:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788652067.569075:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661568:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652067.569245:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.569266:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3e7c480 going to sleep for 11 seconds 00000100:00100000:1.0:1788652067.569333:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147661568 00000100:00100000:1.0:1788652067.569338:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147661568 00000100:00100000:1.0:1788652067.569375:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788652067.569382:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:19509:x1875537147661568:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788652067.569475:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:19509:x1875537147661568:12345-0@lo:502:mount.lustre.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652067.569489:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788652067.570336:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661568:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652067.570985:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788652067.571018:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788652067.571033:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788652067.571046:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788652067.571058:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788652067.571070:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788652067.571085:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788652067.572214:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:2.0:1788652067.572256:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788652067.572272:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:2.0:1788652067.572288:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:2.0:1788652067.572337:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661696:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788652067.572428:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.572473:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c3e7c480 going to sleep for 11 seconds 00000100:00100000:0.0:1788652067.574935:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147661696 00000100:00100000:0.0:1788652067.574952:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147661696 00000100:00100000:0.0:1788652067.575015:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788652067.575026:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:19509:x1875537147661696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788652067.575212:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:19509:x1875537147661696:12345-0@lo:502:mount.lustre.0 Request processed in 188us (2784us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652067.575220:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788652067.575459:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661696:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788652067.575545:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:2.0:1788652067.575559:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788652067.577511:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652067.577524:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652067.577527:0:19517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788652067.577535:0:19517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86f3cfe800 00000020:00000080:3.0:1788652067.577538:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652067.577545:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652067.577548:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652067.577549:0:19517:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788652067.577551:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652067.577553:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652067.577554:0:19517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788652067.577557:0:19517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8f86f3cfe800 00000020:00000080:3.0:1788652067.577559:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652067.577627:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652067.577631:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652067.577633:0:19517:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788652067.577635:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652067.577637:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652067.577638:0:19517:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788652067.577650:0:19517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86f3cfe800 00000020:00000080:3.0:1788652067.577652:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652067.577671:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652067.577674:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652067.577675:0:19517:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788652067.577678:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788652067.577680:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652067.577681:0:19517:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788652067.577684:0:19517:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8f86f3cfe800 00000020:00000080:3.0:1788652067.577686:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788652067.577707:0:19517:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788652067.577711:0:19517:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788652067.577712:0:19517:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788652067.577715:0:19517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:1.0:1788652067.586004:0:19509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788652067.586052:0:19509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788652067.586071:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652067.586082:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652067.586165:0:19509:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788652067.586169:0:19509:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8f86f3cfe800 10000000:01000000:1.0:1788652067.586172:0:19509:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8f86f3cfe800 10000000:01000000:1.0:1788652067.586176:0:19509:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788652067.586182:0:19509:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8f86f3cfe800 from 1 10000000:01000000:1.0:1788652067.586185:0:19509:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788652067.586225:0:19509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652067.586236:0:19509:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652067.586248:0:19509:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652067.586272:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788652067.586335:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652067.586369:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083e900 going to sleep for 11 seconds 00000100:00100000:2.0:1788652067.586611:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147661824 00000100:00100000:2.0:1788652067.586619:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147661824 00000100:00100000:2.0:1788652067.586670:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788652067.586679:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:19509:x1875537147661824:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788652067.586691:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652067.586706:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c6200/0xcd2f56ea038c50fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c50f3 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.586736:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c6200/0xcd2f56ea038c50fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c50f3 expref: 24 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.586748:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c6200/0xcd2f56ea038c50fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c50f3 expref: 24 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.586759:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6200, rc 0) 00000100:00100000:2.0:1788652067.586816:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147661824:12345-0@lo:101:mount.lustre.0 Request processed in 139us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652067.586822:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788652067.587121:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788652067.587137:0:19509:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652067.587160:0:19509:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788652067.589009:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788652067.589308:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788652067.591878:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788652067.591964:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788652067.591980:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788652067.591993:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788652067.592004:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788652067.592016:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788652067.592028:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788652067.592040:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788652067.592053:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788652067.592065:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788652067.592079:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788652067.592104:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788652067.592118:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788652067.592131:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788652067.592145:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788652067.592177:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788652067.596711:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788652067.596766:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788652067.596796:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788652067.596813:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788652067.596828:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788652067.596843:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788652067.596857:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788652067.596872:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788652067.596887:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788652067.596900:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788652067.596942:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788652067.596955:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788652067.596966:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:1.0:1788652067.596978:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:1.0:1788652067.596990:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:1.0:1788652067.597023:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:1.0:1788652067.597040:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:1.0:1788652067.597053:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:1.0:1788652067.597067:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:1.0:1788652067.597081:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:1.0:1788652067.597093:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:1.0:1788652067.597106:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:1.0:1788652067.597117:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:1.0:1788652067.597129:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:1.0:1788652067.597143:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:1.0:1788652067.597157:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:1.0:1788652067.597169:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:1.0:1788652067.597182:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:1.0:1788652067.597195:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:1.0:1788652067.597207:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:1.0:1788652067.597231:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:1.0:1788652067.597236:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:1.0:1788652067.597341:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652067.597419:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652067.604548:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652067.605595:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147661952 00000100:00100000:3.0:1788652067.605606:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147661952 00000100:00100000:3.0:1788652067.605675:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788652067.605686:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147661952:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788652067.608958:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147661952:12345-0@lo:501:mount.lustre.0 Request processed in 3265us (11529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.608970:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788652067.612288:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147661952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788652067.612349:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147662080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788652067.612418:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652067.612471:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f083ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788652067.612526:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147662080 00000100:00100000:3.0:1788652067.612534:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147662080 00000100:00100000:3.0:1788652067.612598:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788652067.612608:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147662080:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788652067.612719:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147662080:12345-0@lo:503:mount.lustre.0 Request processed in 112us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.612727:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788652067.612770:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c368d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147662080:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788652067.613409:0:19509:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788652067.613484:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147662208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652067.613529:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652067.613559:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147662208 00000100:00100000:3.0:1788652067.613564:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147662208 00000100:00100000:3.0:1788652067.613609:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788652067.613617:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147662208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652067.613697:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147662208:12345-0@lo:502:mount.lustre.0 Request processed in 80us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.613704:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788652067.613742:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc55240 going to sleep for 11 seconds 00000100:00100000:3.0:1788652067.613756:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147662208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652067.613956:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788652067.613981:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788652067.613995:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788652067.614009:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788652067.614022:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788652067.614036:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788652067.614048:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788652067.614061:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788652067.614075:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788652067.614088:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788652067.614287:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788652067.614303:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788652067.614317:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788652067.614331:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788652067.614345:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788652067.614358:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788652067.614382:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788652067.614396:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788652067.614410:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788652067.614423:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788652067.614436:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788652067.614450:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788652067.614464:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788652067.614478:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788652067.614491:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788652067.614504:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788652067.614518:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788652067.614533:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788652067.614546:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788652067.614559:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788652067.614572:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788652067.614868:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788652067.614988:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788652067.615010:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788652067.615026:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788652067.615040:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788652067.615055:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788652067.615068:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788652067.615083:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788652067.619813:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788652067.619859:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788652067.619874:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788652067.619887:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788652067.619900:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788652067.619930:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788652067.619947:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:3.0:1788652067.619962:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788652067.619978:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788652067.620069:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147662336:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652067.620885:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652067.620957:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147662336 00000100:00100000:3.0:1788652067.620965:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147662336 00000100:00100000:3.0:1788652067.621016:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788652067.621026:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147662336:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652067.621721:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147662336:12345-0@lo:502:mount.lustre.0 Request processed in 696us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.621730:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788652067.621799:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc55240 going to sleep for 11 seconds 00000100:00100000:3.0:1788652067.621820:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147662336:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652067.625797:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788652067.625830:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:3.0:1788652067.625875:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147662464:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652067.625967:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652067.626010:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147662464 00000100:00100000:3.0:1788652067.626016:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147662464 00000100:00100000:3.0:1788652067.626059:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788652067.626068:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147662464:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788652067.626183:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147662464:12345-0@lo:502:mount.lustre.0 Request processed in 116us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.626191:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788652067.626234:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc55240 going to sleep for 11 seconds 00000100:00100000:3.0:1788652067.626254:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147662464:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788652067.626293:0:19509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:3.0:1788652067.626300:0:19509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788652067.629763:0:19522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788652067.629797:0:19522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8f85c217b380) 00000020:00000080:3.0:1788652067.629824:0:19522:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788652067.629944:0:19522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86f3cfe800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788652067.629949:0:19522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86f3cfe800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788652067.629951:0:19522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86f3cfe800 3 00010000:00080000:3.0:1788652067.629986:0:19522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c3093800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.145@tcp at head 00010000:00010000:3.0:1788652067.636057:0:19522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788652067.639258:0:19522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788652067.639319:0:19522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788652067.639335:0:19522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xcd2f56ea038c5108 00000100:00080000:3.0:1788652067.639346:0:19522:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788652067.639353:0:19522:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8f85c3093800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652067.644254:0:19522:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c3710a80 x1875537147662592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652067.644294:0:19522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788652067.644331:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147662592:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788652067.644411:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652067.646224:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147662592 00000100:00100000:3.0:1788652067.646238:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147662592 00000100:00100000:3.0:1788652067.646284:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788652067.646292:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3634:x1875537147662592:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788652067.646319:0:17186:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:3.0:1788652067.646354:0:17186:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xcd2f56ea038c510f 00000004:00100000:3.0:1788652067.646368:0:17186:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788652067.646400:0:17186:0:(import.c:65:import_set_state_nolock()) ffff8f85c3091800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652067.646477:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3634:x1875537147662592:12345-0@lo:38:llog_process_th.0 Request processed in 185us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.646485:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788652067.647097:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c3710a80 x1875537147662592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652067.647109:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652067.647117:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788652067.647125:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788652067.647130:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788652067.647133:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c3093800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788652067.647139:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3710a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3634:1875537147662592:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788652067.648288:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652067.648295:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788652067.648299:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788652067.648306:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:2.0:1788652067.648321:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788652067.648329:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f85c373a800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652067.648364:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86d109b480 x1875537147662976/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788652067.648419:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788652067.648422:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788652067.648424:0:36:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788652067.648427:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 518 00000100:00080000:2.0:1788652067.648430:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788652067.648433:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f86c6e8e000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:2.0:1788652067.648444:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c3d51180 x1875537147663488/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788652067.648492:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147662848:0@lo:400:kworker.0 00000100:00100000:2.0:1788652067.648550:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.648578:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147663616:0@lo:400:kworker.0 00000100:00100000:2.0:1788652067.648600:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.648621:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788652067.648627:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147663104:0@lo:400:kworker.0 00000100:00100000:2.0:1788652067.648647:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.648663:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147663744:0@lo:400:kworker.0 00000100:00100000:2.0:1788652067.648682:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.648710:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147663616 00000100:00100000:2.0:1788652067.648716:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147663616 00000100:00100000:2.0:1788652067.648753:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147663104 00000100:00100000:2.0:1788652067.648756:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147663104 00000100:00100000:2.0:1788652067.648788:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147663744 00000100:00100000:2.0:1788652067.648792:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147663744 00000100:00100000:2.0:1788652067.648820:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788652067.648827:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147663616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652067.648876:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147663616:12345-0@lo:400:kworker.0 Request processed in 49us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652067.648883:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788652067.648900:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788652067.648923:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147663104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652067.648952:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147663104:12345-0@lo:400:kworker.0 Request processed in 47us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652067.648959:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788652067.648970:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788652067.648977:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147663744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652067.648999:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147663744:12345-0@lo:400:kworker.0 Request processed in 24us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652067.649004:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788652067.649024:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788652067.649045:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86d109b800 x1875537147663104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652067.649055:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147663104:0@lo:400:kworker.0 00010000:00080000:2.0:1788652067.649066:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c3d51f80 x1875537147663744/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652067.649073:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147663744:0@lo:400:kworker.0 00010000:00080000:2.0:1788652067.649082:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c3d53b80 x1875537147663616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652067.649580:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147662976:0@lo:8:kworker.0 00000100:00100000:1.0:1788652067.649619:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652067.649642:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147663488:0@lo:8:kworker.0 00000100:00100000:1.0:1788652067.649663:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652067.650246:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147662720:0@lo:400:kworker.0 00000100:00100000:0.0:1788652067.650279:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652067.650305:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147663360:0@lo:400:kworker.0 00000100:00100000:0.0:1788652067.650323:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652067.650344:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788652067.650349:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147663232:0@lo:400:kworker.0 00000100:00100000:0.0:1788652067.650365:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652067.650380:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147663872:0@lo:400:kworker.0 00000100:00100000:0.0:1788652067.650428:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652067.651274:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147662848 00000100:00100000:3.0:1788652067.651284:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147662848 00000100:00100000:3.0:1788652067.651336:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147662976 00000100:00100000:3.0:1788652067.651340:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147662976 00000100:00100000:3.0:1788652067.651350:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147663488 00000100:00100000:3.0:1788652067.651353:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147663488 00000100:00100000:3.0:1788652067.651360:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147663360 00000100:00100000:3.0:1788652067.651362:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147663360 00000100:00100000:3.0:1788652067.651380:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788652067.651475:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147662720 00000100:00100000:1.0:1788652067.651481:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147662720 00000100:00100000:1.0:1788652067.651508:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147663232 00000100:00100000:1.0:1788652067.651511:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147663232 00000100:00100000:1.0:1788652067.651524:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788652067.651531:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147662720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652067.651593:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147662720:12345-0@lo:400:kworker.0 Request processed in 62us (1312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652067.651601:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788652067.651616:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788652067.651622:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147663232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652067.651651:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147663232:12345-0@lo:400:kworker.0 Request processed in 29us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652067.651663:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788652067.652191:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147662848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652067.652240:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147662848:12345-0@lo:400:kworker.0 Request processed in 851us (3689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.652247:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788652067.652263:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652067.652271:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147663360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652067.652298:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147663360:12345-0@lo:400:kworker.0 Request processed in 29us (1973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.652304:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788652067.652316:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788652067.652321:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3634:x1875537147662976:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788652067.652373:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3634:x1875537147662976:12345-0@lo:8:kworker.0 Request processed in 51us (2754us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788652067.652379:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652067.652803:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652067.652811:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652067.652816:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788652067.652819:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147662976:0@lo:8:kworker.0 00000100:00100000:3.0:1788652067.652864:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652067.652871:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3634:x1875537147663488:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788652067.652942:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3634:x1875537147663488:12345-0@lo:8:kworker.0 Request processed in 69us (3278us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788652067.652948:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1788652067.652969:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788652067.653187:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652067.653192:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788652067.653196:0:3634:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788652067.653199:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147663488:0@lo:8:kworker.0 00000100:00100000:2.0:1788652067.653681:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147663616:0@lo:400:kworker.0 00000100:00100000:2.0:1788652067.653714:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147662848:0@lo:400:kworker.0 00000100:00100000:2.0:1788652067.653762:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147663872 00000100:00100000:2.0:1788652067.653768:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147663872 00000100:00100000:2.0:1788652067.653830:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788652067.653838:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147663872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652067.653883:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147663872:12345-0@lo:400:kworker.0 Request processed in 47us (3455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652067.653890:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788652067.655370:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147663232:0@lo:400:kworker.0 00010000:00080000:0.0:1788652067.655389:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f85c3d50e00 x1875537147663872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652067.655400:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147663872:0@lo:400:kworker.0 00000100:00100000:0.0:1788652067.655415:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147662720:0@lo:400:kworker.0 00000100:00100000:0.0:1788652067.655426:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147663360:0@lo:400:kworker.0 00000100:00080000:3.0:1788652067.656992:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:01000004:0.0:1788652067.660310:0:19522:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788652067.660690:0:19522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8f85c3d30000) 00000020:00000080:0.0:1788652067.660717:0:19522:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:0.0:1788652067.660808:0:19522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8f86f3cfe800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788652067.660812:0:19522:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8f86f3cfe800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788652067.660815:0:19522:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8f86f3cfe800 3 00010000:00080000:0.0:1788652067.660845:0:19522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8f85c32ca000@lustre-MDT0001-lwp-OST0001: add connection 192.168.204.145@tcp at head 00010000:00010000:0.0:1788652067.665312:0:19522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788652067.667511:0:19522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788652067.667564:0:19522:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788652067.667580:0:19522:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xcd2f56ea038c511d 00000100:00080000:0.0:1788652067.667591:0:19522:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788652067.667597:0:19522:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8f85c32ca000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:0.0:1788652067.667635:0:19522:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86f48d1f80 x1875537147664000/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788652067.667690:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875537147664000:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788652067.667762:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788652067.667838:0:19522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1788652067.668107:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147664000 00000100:00100000:2.0:1788652067.668115:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147664000 00000100:00100000:2.0:1788652067.668146:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788652067.668153:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3634:x1875537147664000:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788652067.668178:0:17188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:2.0:1788652067.668206:0:17188:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xcd2f56ea038c5124 00000004:00100000:2.0:1788652067.668222:0:17188:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788652067.668250:0:17188:0:(import.c:65:import_set_state_nolock()) ffff8f85c35ce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788652067.673961:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3634:x1875537147664000:12345-0@lo:38:llog_process_th.0 Request processed in 5792us (6183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652067.673979:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:0.0:1788652067.676386:0:19522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788652067.676636:0:19509:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788652067.676678:0:19509:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788652067.676703:0:19509:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652067.676714:0:19509:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f87021f8000/0xcd2f56ea038c50f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c50fa expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788652067.676763:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788652067.676766:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788652067.676767:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652067.676768:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652067.676769:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652067.676771:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652067.676772:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788652067.676773:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652067.676784:0:19509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652067.676788:0:19509:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788652067.676791:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788652067.676792:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788652067.676793:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788652067.676794:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788652067.676795:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788652067.676796:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788652067.676797:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788652067.676798:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788652067.676799:0:19509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788652067.676828:0:19509:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788652067.676847:0:19509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147664128:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788652067.676931:0:19509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652067.676971:0:19509:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2c2c600 going to sleep for 11 seconds 00010000:00080000:1.0:1788652067.677578:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8f86f48d1f80 x1875537147664000/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788652077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652067.677591:0:3634:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788652067.677600:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788652067.677630:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788652067.677635:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788652067.677638:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c32ca000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788652067.677646:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3634:1875537147664000:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788652067.677880:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147664128 00000100:00100000:3.0:1788652067.677889:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147664128 00000100:00100000:3.0:1788652067.677957:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788652067.677966:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:19509:x1875537147664128:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788652067.677994:0:17181:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788652067.678008:0:17181:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788652067.692705:0:17181:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788652067.692721:0:17181:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788652067.692814:0:17202:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788652067.692819:0:17202:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788652067.692842:0:17202:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.692864:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c4fd4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4fcd expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.692872:0:17202:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86f4b96e00/0xcd2f56ea038c4fe2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4fdb expref: 24 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.692879:0:17202:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.692946:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86f4b96e00/0xcd2f56ea038c4fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4fdb expref: 24 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.692962:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86f4b96e00/0xcd2f56ea038c4fe2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4fdb expref: 24 pid: 17179 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652067.692976:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147664256:0@lo:104: 00000100:00100000:3.0:1788652067.693046:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.693077:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147664256 00000100:00100000:2.0:1788652067.693091:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147664256 00010000:00010000:3.0:1788652067.693106:0:17202:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c4fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4fcd expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.693124:0:17202:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c4fd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4fcd expref: 24 pid: 17181 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652067.693132:0:17202:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147664384:0@lo:104: 00000100:00100000:2.0:1788652067.693136:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652067.693144:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3711880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:17202:x1875537147664256:12345-0@lo:104: 00000100:00100000:3.0:1788652067.693154:0:17202:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788652067.693157:0:17171:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652067.693164:0:17202:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fcc55780 going to sleep for 11 seconds 00010000:00010000:2.0:1788652067.693222:0:17171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788652067.693228:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3711880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:17202:x1875537147664256:12345-0@lo:104: Request processed in 85us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652067.693235:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652067.693250:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147664384 00000100:00100000:2.0:1788652067.693254:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147664384 00000100:00100000:2.0:1788652067.693270:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788652067.693275:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:17202:x1875537147664384:12345-0@lo:104: 00010000:00010000:2.0:1788652067.693282:0:17171:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693313:0:17171:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788652067.693318:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3710a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:17202:x1875537147664384:12345-0@lo:104: Request processed in 43us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652067.693323:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788652067.693341:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652067.693346:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693353:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97000 already unused, calling callback (ffffffffc149cc20) 00000100:00100000:3.0:1788652067.693357:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147664256:0@lo:104: 10000000:00010000:2.0:1788652067.693358:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652067.693365:0:17202:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17202:1875537147664384:0@lo:104: 00010000:00010000:2.0:1788652067.693366:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652067.693373:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.693386:0:17202:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652067.693388:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652067.693440:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693447:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652067.693469:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693476:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97000/0xcd2f56ea038c4fdb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4fe2 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693488:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652067.693491:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693496:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97400 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:2.0:1788652067.693499:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693505:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788652067.693511:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652067.693516:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788652067.693527:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693533:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788652067.693554:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693560:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97400/0xcd2f56ea038c4fcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4fd4 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693571:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652067.693573:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652067.693575:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652067.693581:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652067.693591:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147664512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652067.693622:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.693653:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147664640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652067.693676:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652067.693705:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147664512 00000100:00100000:2.0:1788652067.693709:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147664512 00010000:00010000:2.0:1788652067.693728:0:17173:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86f4b96e00/0xcd2f56ea038c4fe2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4fdb expref: 25 pid: 17179 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652067.693749:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147664640 00000100:00100000:2.0:1788652067.693751:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147664640 00010000:00010000:2.0:1788652067.693762:0:17173:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c4fd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4fcd expref: 26 pid: 17181 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652067.693790:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652067.693798:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+26:3636:x1875537147664512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652067.693808:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652067.693813:0:17173:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86f4b96e00/0xcd2f56ea038c4fe2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4fdb expref: 26 pid: 17179 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693834:0:17173:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86f4b96e00/0xcd2f56ea038c4fe2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4fdb expref: 26 pid: 17179 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693848:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b96e00/0xcd2f56ea038c4fe2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4fdb expref: 26 pid: 17179 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693862:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652067.693890:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+25:3636:x1875537147664512:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652067.693897:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788652067.693931:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788652067.693938:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3637:x1875537147664640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788652067.693961:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652067.693966:0:17173:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c4fd4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4fcd expref: 24 pid: 17181 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693975:0:17173:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c4fd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4fcd expref: 24 pid: 17181 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693984:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c4fd4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4fcd expref: 24 pid: 17181 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.693994:0:17173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.694001:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788652067.694014:0:17173:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.011767327s 00010000:00010000:2.0:1788652067.694024:0:17173:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.694032:0:17173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.694039:0:17173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.694045:0:17173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.694050:0:17173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0906000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652067.694054:0:17173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.694061:0:17173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.694081:0:17173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652067.694091:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652067.694120:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d52680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:3637:x1875537147664640:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652067.694127:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788652067.694160:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a28e2822-101e-46fe-b9c1-7a60e90536a9:3636:1875537147664512:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652067.694161:0:17202:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.694169:0:17202:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652067.694175:0:17202:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f0906000/0xcd2f56ea038c512b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652067.694177:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147664640:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652067.694760:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:19509:x1875537147664128:12345-0@lo:253:mount.lustre.0 Request processed in 16789us (17823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652067.694769:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788652067.695038:0:19509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a28e2822-101e-46fe-b9c1-7a60e90536a9:19509:1875537147664128:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788652067.695059:0:19509:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788652067.695062:0:19509:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788652067.695063:0:19509:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788652067.695065:0:19509:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788652067.695066:0:19509:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788652067.695067:0:19509:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788652067.695068:0:19509:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788652067.695070:0:19509:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788652067.695071:0:19509:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788652067.695073:0:19509:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788652067.695084:0:19509:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788652067.707559:0:19509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788652067.716137:0:19509:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788652067.716146:0:19509:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788652067.716186:0:19509:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788652067.716235:0:19509:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.145@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788652067.716271:0:19509:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788652067.716291:0:19509:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:3.0:1788652067.717137:0:19509:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652067.717354:0:19509:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788652067.809096:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147664768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652067.809171:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652067.809253:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147664768 00000100:00100000:0.0:1788652067.809263:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147664768 00000100:00100000:0.0:1788652067.809313:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788652067.809322:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147664768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788652067.809353:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788652067.809402:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147664768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652067.809410:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788652067.818503:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147664768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788652068.393679:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788652068.704644:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788652068.704653:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f85c3548800 from 10 10000000:01000000:3.0:1788652068.704658:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788652068.704705:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.704716:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.704728:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652068.704753:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147664896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788652068.704841:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652068.704885:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0968cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652068.704945:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147664896 00000100:00100000:3.0:1788652068.704953:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147664896 00000100:00100000:3.0:1788652068.705014:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788652068.705023:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:17184:x1875537147664896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652068.705039:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652068.705054:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f0906200/0xcd2f56ea038c5139 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5132 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.705089:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f0906200/0xcd2f56ea038c5139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5132 expref: 23 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.705101:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f0906200/0xcd2f56ea038c5139 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5132 expref: 23 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.705129:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0906200, rc 0) 00000100:00100000:3.0:1788652068.705169:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:17184:x1875537147664896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652068.705176:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788652068.705222:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147664896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652068.705239:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.705247:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652068.705298:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147665024:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788652068.705330:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652068.705361:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0968cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652068.705375:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147665024 00000100:00100000:3.0:1788652068.705379:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147665024 00000100:00100000:3.0:1788652068.705403:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788652068.705410:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:17184:x1875537147665024:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788652068.705424:0:17181:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788652068.705440:0:17181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788652068.705444:0:17181:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788652068.705521:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:17184:x1875537147665024:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652068.705529:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788652068.705561:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147665024:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788652068.705630:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788652068.705640:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.705648:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f0906000/0xcd2f56ea038c5132 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5139 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652068.705656:0:17184:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788652068.705658:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8f86c3255800 from 10 10000000:01000000:3.0:1788652068.705660:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788652068.705676:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.705684:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.705691:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652068.705702:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147665152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788652068.705725:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652068.705738:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0968cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652068.705749:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147665152 00000100:00100000:3.0:1788652068.705752:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147665152 00000100:00100000:3.0:1788652068.705785:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788652068.705791:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:17184:x1875537147665152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652068.705798:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652068.705806:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f0907e00/0xcd2f56ea038c5147 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c5140 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.705830:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f0907e00/0xcd2f56ea038c5147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c5140 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.705837:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f0907e00/0xcd2f56ea038c5147 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c5140 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.705843:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907e00, rc 0) 00000100:00100000:3.0:1788652068.705868:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:17184:x1875537147665152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652068.705874:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788652068.705902:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147665152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652068.705949:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.705958:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652068.705993:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147665280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788652068.706032:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652068.706051:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0968cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652068.706063:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147665280 00000100:00100000:3.0:1788652068.706066:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147665280 00000100:00100000:3.0:1788652068.706086:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788652068.706092:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:17184:x1875537147665280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788652068.706102:0:17181:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788652068.706113:0:17181:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788652068.706120:0:17181:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:3.0:1788652068.706179:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:17184:x1875537147665280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 86us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652068.706185:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788652068.706214:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147665280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788652068.706250:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788652068.706258:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652068.706264:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86f0906a00/0xcd2f56ea038c5140 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c5147 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652068.843258:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147665408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788652068.843334:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652068.850001:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147665408 00000100:00100000:0.0:1788652068.850018:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147665408 00000100:00100000:0.0:1788652068.850099:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788652068.850109:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147665408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788652068.850142:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788652068.850235:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147665408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (6900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652068.850243:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788652068.850304:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147665408:0@lo:13:osp-pre-0-1.0 00000020:00000004:3.0:1788652068.967000:0:19576:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652068.970327:0:19576:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:1.0:1788652069.089473:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788652069.409141:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652069.859391:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147665536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788652069.859472:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652069.859539:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147665536 00000100:00100000:0.0:1788652069.859564:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147665536 00000100:00100000:0.0:1788652069.859617:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788652069.859627:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147665536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788652069.859684:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788652069.859748:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147665536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652069.859756:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788652069.859811:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147665536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788652069.860049:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652069.860059:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147665664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652069.860100:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652069.860131:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147665664 00000100:00100000:3.0:1788652069.860135:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147665664 00000100:00100000:3.0:1788652069.860162:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788652069.860169:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147665664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788652069.860188:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788652069.860223:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147665664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652069.860229:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788652069.860258:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147665664:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788652070.433187:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652071.456063:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.480097:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652072.928383:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652072.928409:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147665792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652072.928485:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652072.928572:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147665792 00000100:00100000:2.0:1788652072.928580:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147665792 00000100:00100000:2.0:1788652072.928633:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652072.928644:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147665792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652072.928684:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788652072.928730:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147665792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652072.928738:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788652072.928783:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147665792:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788652072.929374:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652072.930007:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652072.930071:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788652072.930074:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652072.930085:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8f85c373a800 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652072.930110:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f85c3713480 x1875537147666176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788652072.930159:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788652072.930162:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788652072.930164:0:38:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788652072.930168:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8f86c6e8e000 using connection 192.168.204.145@tcp/0@lo 00000100:00100000:3.0:1788652072.930179:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8f86ff461500 x1875537147666688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788652072.930226:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147665920:0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.930717:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147666048:0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.930767:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652072.930806:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147666816:0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.930828:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652072.930846:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147667328:0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.930866:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652072.930932:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147666816 00000100:00100000:2.0:1788652072.930940:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147666816 00000100:00100000:2.0:1788652072.930977:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147667328 00000100:00100000:2.0:1788652072.930980:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147667328 00000100:00100000:2.0:1788652072.931004:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788652072.931022:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147666816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.931067:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3636:x1875537147666816:12345-0@lo:400:kworker.0 Request processed in 56us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652072.931073:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788652072.931086:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652072.931091:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147667328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.931113:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3636:x1875537147667328:12345-0@lo:400:kworker.0 Request processed in 22us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652072.931118:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788652072.931138:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147666304:0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.931159:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652072.931172:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147666944:0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.931187:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652072.931200:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788652072.931205:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147666432:0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.931230:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652072.931248:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147667072:0@lo:400:kworker.0 00000100:00100000:0.0:1788652072.931410:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147666176:0@lo:8:kworker.0 00000100:00100000:3.0:1788652072.935724:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652072.935804:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147666560:0@lo:400:kworker.0 00000100:00100000:3.0:1788652072.935863:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652072.935978:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147667200:0@lo:400:kworker.0 00000100:00100000:3.0:1788652072.936080:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652072.936142:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147666048 00000100:00100000:3.0:1788652072.936151:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147666048 00000100:00100000:3.0:1788652072.936200:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147666432 00000100:00100000:3.0:1788652072.936203:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147666432 00000100:00100000:3.0:1788652072.936219:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788652072.936227:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147666048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652072.936419:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147666048:12345-0@lo:400:kworker.0 Request processed in 191us (5650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652072.936441:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788652072.936460:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788652072.936467:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147666432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652072.936499:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147666432:12345-0@lo:400:kworker.0 Request processed in 33us (5268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652072.936505:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788652072.936526:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147665920 00000100:00100000:3.0:1788652072.936530:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147665920 00000100:00100000:3.0:1788652072.936551:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788652072.936568:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3635:x1875537147665920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652072.936600:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3635:x1875537147665920:12345-0@lo:400:kworker.0 Request processed in 43us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652072.936605:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788652072.936627:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147666560 00000100:00100000:3.0:1788652072.936629:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147666560 00000100:00100000:3.0:1788652072.936655:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652072.936660:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147666560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652072.936700:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147666560:12345-0@lo:400:kworker.0 Request processed in 39us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652072.936706:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788652072.936733:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147666304 00000100:00100000:3.0:1788652072.936738:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147666304 00000100:00100000:3.0:1788652072.936753:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147666944 00000100:00100000:3.0:1788652072.936756:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147666944 00000100:00100000:3.0:1788652072.936770:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147667200 00000100:00100000:3.0:1788652072.936772:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147667200 00000100:00100000:3.0:1788652072.936785:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788652072.936798:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147666304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652072.936829:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147666304:12345-0@lo:400:kworker.0 Request processed in 32us (5670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652072.936834:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788652072.936844:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788652072.936849:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147666944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652072.936871:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3637:x1875537147666944:12345-0@lo:400:kworker.0 Request processed in 22us (5683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652072.936876:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788652072.936899:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788652072.936938:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147667200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652072.936966:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3635:x1875537147667200:12345-0@lo:400:kworker.0 Request processed in 61us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652072.936972:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788652072.936995:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788652072.937000:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788652072.937002:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788652072.937237:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147665920:0@lo:400:kworker.0 00000100:00100000:3.0:1788652072.937253:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147666560:0@lo:400:kworker.0 00010000:00080000:3.0:1788652072.937276:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff462d80 x1875537147667200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652072.937286:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff462d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3635:1875537147667200:0@lo:400:kworker.0 00000100:00100000:0.0:1788652072.940456:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652072.940497:0:3634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147666688:0@lo:8:kworker.0 00000100:00100000:0.0:1788652072.940524:0:3634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652072.940582:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147666176 00000100:00100000:0.0:1788652072.940591:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147666176 00000100:00100000:0.0:1788652072.940627:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147666688 00000100:00100000:0.0:1788652072.940630:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147666688 00000100:00100000:0.0:1788652072.940654:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652072.940659:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788652072.940660:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3634:x1875537147666176:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788652072.940665:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3634:x1875537147666688:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788652072.940714:0:18693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:0.0:1788652072.940745:0:18693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xcd2f56ea038c514e 00002000:00100000:0.0:1788652072.940760:0:18693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8f85c32cf800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788652072.940764:0:18693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788652072.940768:0:18693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788652072.941266:0:18693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788652072.941293:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8f85c32cd800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652072.941352:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3634:x1875537147666176:12345-0@lo:8:kworker.0 Request processed in 690us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652072.941360:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652072.941574:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788652072.941625:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3712d80 x1875537147666304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652072.941639:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147666304:0@lo:400:kworker.0 00010000:00080000:2.0:1788652072.941654:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff461f80 x1875537147666944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652072.941663:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3637:1875537147666944:0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.941702:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147666432:0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.941797:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147667072 00000100:00100000:2.0:1788652072.941803:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147667072 00000100:00100000:2.0:1788652072.941847:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788652072.941854:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147667072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652072.941931:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3637:x1875537147667072:12345-0@lo:400:kworker.0 Request processed in 76us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652072.941937:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788652072.941956:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788652072.941996:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3712680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147666048:0@lo:400:kworker.0 00010000:00080000:2.0:1788652072.942184:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff461c00 x1875537147666816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652072.942195:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3636:1875537147666816:0@lo:400:kworker.0 00010000:00080000:2.0:1788652072.942212:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff463100 x1875537147667328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652072.942230:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff463100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3636:1875537147667328:0@lo:400:kworker.0 00010000:00080000:2.0:1788652072.942275:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff460000 x1875537147667072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652072.942283:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff460000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3637:1875537147667072:0@lo:400:kworker.0 00010000:00080000:1.0:1788652072.942285:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3713480 x1875537147666176/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788652072.942308:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788652072.942316:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788652072.942321:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788652072.942323:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f85c373a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788652072.942345:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788652072.942350:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3713480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3634:1875537147666176:0@lo:8:kworker.0 00000004:00080000:1.0:1788652072.942370:0:17212:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788652072.942385:0:17213:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788652072.942408:0:17213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d50e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17213:1875537147667584:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788652072.942442:0:17213:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652072.942460:0:17213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f0952000 going to sleep for 11 seconds 00000004:00080000:1.0:1788652072.942462:0:17212:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 528877553558ns, next at 0ns, rc = 0 00080000:00080000:1.0:1788652072.942467:0:17212:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788652072.942474:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147667584 00000100:00100000:2.0:1788652072.942479:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147667584 00000100:00100000:2.0:1788652072.942511:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788652072.942519:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17213:x1875537147667584:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1788652072.942816:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652072.942826:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147667456:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652072.942852:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652072.943948:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147667456 00000100:00100000:1.0:1788652072.943959:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147667456 00000100:00100000:1.0:1788652072.944006:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788652072.944015:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875537147667456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652072.944048:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788652072.944117:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3637:x1875537147667456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652072.944124:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788652072.944662:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3d53b80 x1875537147667456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652072.944694:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147667456:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788652072.946627:0:17167:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:3.0:1788652072.948394:0:18694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:3.0:1788652072.948431:0:18694:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xcd2f56ea038c5155 00002000:00100000:3.0:1788652072.948448:0:18694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8f85c3094800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1788652072.948452:0:18694:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1788652072.948455:0:18694:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788652072.948513:0:18694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1788652072.948537:0:18694:0:(import.c:65:import_set_state_nolock()) ffff8f85c3094000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652072.948636:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3634:x1875537147666688:12345-0@lo:8:kworker.0 Request processed in 7969us (8110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652072.948647:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788652072.948714:0:3634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff461500 x1875537147666688/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788652097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788652072.948730:0:3634:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788652072.948738:0:3634:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788652072.948743:0:3634:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788652072.948746:0:3634:0:(import.c:65:import_set_state_nolock()) ffff8f86c6e8e000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00002000:00080000:2.0:1788652072.951450:0:18692:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788652072.951468:0:18692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788652072.951476:0:18692:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000004:00080000:0.0:1788652072.953328:0:17929:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788652072.953379:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652072.953404:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147667712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788652072.953404:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17929:1875537147667840:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788652072.953471:0:3634:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788652072.953483:0:3634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff461500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3634:1875537147666688:0@lo:8:kworker.0 00000100:00100000:1.0:1788652072.960135:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652072.960213:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147667712 00000100:00100000:1.0:1788652072.960223:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147667712 00000100:00100000:1.0:1788652072.960499:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788652072.960508:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1875537147667712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788652072.960539:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788652072.961154:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3637:x1875537147667712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 645us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652072.961176:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788652072.961233:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86ff518e00 x1875537147667712/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788652088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652072.961997:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147667712:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788652072.964241:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788652072.964877:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652072.964935:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4a47c00 going to sleep for 11 seconds 00000004:00080000:0.0:1788652072.964960:0:17928:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788652072.965071:0:17928:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 528900162406ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788652072.965078:0:17928:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00002000:00010000:2.0:1788652072.965689:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.965706:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c515c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.965723:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.965727:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.965734:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c515c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.965751:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c515c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.965762:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c515c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.965770:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c515c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652072.965859:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147667840 00010000:00010000:2.0:1788652072.965870:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788652072.965871:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147667840 00000100:00100000:1.0:1788652072.965937:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788652072.965949:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17929:x1875537147667840:12345-0@lo:7:osp-pre-1-1.0 00002000:00010000:2.0:1788652072.966522:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.966530:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c5163 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.966540:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.966544:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.966549:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c5163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1788652072.967137:0:19081:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788652072.967145:0:19081:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00010000:00010000:2.0:1788652072.967173:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c5163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967190:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c5163 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967196:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c5163 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967216:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788652072.967227:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652072.967233:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c515c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967241:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652072.967246:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c515c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967254:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c515c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967339:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c515c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967346:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c515c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967368:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652072.967377:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c5163 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967384:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652072.967387:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c5163 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967395:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c5163 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967406:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c5163 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967413:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c5163 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.967424:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652072.967426:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652072.967427:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652072.968188:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.968197:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c516a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.968208:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.968212:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.968217:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c516a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.968239:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c516a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.968248:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c516a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.968619:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c516a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652072.971409:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17929:x1875537147667840:12345-0@lo:7:osp-pre-1-1.0 Request processed in 5451us (6526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652072.971423:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:2.0:1788652072.972528:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652072.976873:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652072.977024:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c516a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.977041:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.977047:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c516a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.977060:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c516a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.977087:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c516a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.977096:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c516a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.977121:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.977123:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.977125:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.977137:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652072.977278:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17929:1875537147667840:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1788652072.977293:0:17929:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:0.0:1788652072.977335:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17929:1875537147667968:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788652072.977403:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652072.977446:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4a47c00 going to sleep for 11 seconds 00002000:00010000:2.0:1788652072.978668:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.978721:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5171 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.978737:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.978741:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.978747:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5171 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.978762:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5171 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.978773:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5171 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.978794:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5171 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.978816:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652072.978833:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652072.978838:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5171 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.978846:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652072.978850:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5171 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.978859:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5171 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.978872:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5171 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.978981:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000037a4b99/0xcd2f56ea038c5171 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.979117:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652072.979119:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652072.979120:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652072.980161:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.980182:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5178 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.980195:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.980199:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.980205:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.980218:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.980229:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.980236:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.980393:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788652072.980397:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147667968 00000100:00100000:3.0:1788652072.980409:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147667968 00000100:00100000:3.0:1788652072.980477:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788652072.980487:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17929:x1875537147667968:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:3.0:1788652072.980521:0:18694:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788652072.980606:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17929:x1875537147667968:12345-0@lo:5:osp-pre-1-1.0 Request processed in 120us (3203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652072.980614:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:0.0:1788652072.981091:0:17918:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788652072.981144:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17929:1875537147667968:0@lo:5:osp-pre-1-1.0 00002000:00010000:2.0:1788652072.981153:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:0.0:1788652072.981158:0:17929:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00010000:00010000:2.0:1788652072.981159:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c517f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.981169:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.981172:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.981176:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c517f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.981186:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c517f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652072.981200:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17929:1875537147668096:0@lo:5:osp-pre-1-1.0 00010000:00010000:2.0:1788652072.981201:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c517f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.981209:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c517f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.981223:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:0.0:1788652072.981238:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652072.981263:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4a47c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788652072.981276:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652072.981283:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.981291:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.981296:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.981306:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5178 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.981323:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5178 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.981330:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cb87c3b/0xcd2f56ea038c5178 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.981346:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652072.981349:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c517f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.981362:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.981365:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c517f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.981371:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c517f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.981381:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c517f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.981388:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000062806d/0xcd2f56ea038c517f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.981401:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.981404:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.981405:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652072.981419:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147668096 00000100:00100000:0.0:1788652072.981424:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147668096 00000100:00100000:0.0:1788652072.981456:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788652072.981463:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17929:x1875537147668096:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788652072.981492:0:19081:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00010000:00010000:0.0:1788652072.981568:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652072.981860:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.981866:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a164e691/0xcd2f56ea038c5186 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.981875:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.981878:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.981893:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a164e691/0xcd2f56ea038c5186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.981903:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a164e691/0xcd2f56ea038c5186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.981931:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a164e691/0xcd2f56ea038c5186 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.981939:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a164e691/0xcd2f56ea038c5186 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.981969:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788652072.982462:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.982469:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c518d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.982480:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.982484:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.982488:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c518d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.982497:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c518d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.982505:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c518d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.982513:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c518d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.982524:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788652072.982847:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.982853:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5194 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.982861:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.982870:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.982875:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5194 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.982967:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5194 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.982975:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5194 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.982983:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5194 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.983107:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1788652072.983451:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.983458:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c519b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.983466:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.983469:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.983473:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c519b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.983483:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c519b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.983491:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c519b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.983505:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c519b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.983513:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788652072.983876:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788652072.983990:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788652072.983998:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a164e691/0xcd2f56ea038c5186 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.984017:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.984022:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a164e691/0xcd2f56ea038c5186 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.984031:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a164e691/0xcd2f56ea038c5186 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.984046:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a164e691/0xcd2f56ea038c5186 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.984129:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51a2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.984139:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.984142:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.984146:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.984154:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.984162:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51a2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.984168:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.984178:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1788652072.984548:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.984565:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.984580:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.984583:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.984588:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.984598:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.984607:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.984614:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.984624:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1788652072.984763:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a164e691/0xcd2f56ea038c5186 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.984786:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788652072.984791:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c518d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.984811:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.984814:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c518d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.984823:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c518d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.984835:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c518d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.984849:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028007994/0xcd2f56ea038c518d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.984865:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788652072.984869:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5194 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.984875:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.984879:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5194 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652072.985101:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.985107:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c783035/0xcd2f56ea038c51b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.985116:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.985120:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.985124:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c783035/0xcd2f56ea038c51b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.985134:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c783035/0xcd2f56ea038c51b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.985153:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c783035/0xcd2f56ea038c51b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.985160:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c783035/0xcd2f56ea038c51b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.985169:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1788652072.985212:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5194 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985224:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5194 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985231:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c5194 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985247:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788652072.985252:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c519b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985258:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.985267:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c519b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985276:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c519b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985285:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c519b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985292:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c519b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985306:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788652072.985310:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985316:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.985319:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51a2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985326:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51a2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985335:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51a2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985340:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51a2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985360:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652072.985364:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985370:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.985373:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985381:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985391:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985398:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985409:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652072.985413:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c783035/0xcd2f56ea038c51b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985419:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b96e00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.985422:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c783035/0xcd2f56ea038c51b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985441:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c783035/0xcd2f56ea038c51b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985452:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c783035/0xcd2f56ea038c51b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985460:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c783035/0xcd2f56ea038c51b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.985475:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.985477:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.985478:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.985588:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.985595:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652072.986181:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.986188:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bfc0623/0xcd2f56ea038c51b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986198:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.986201:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.986206:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003bfc0623/0xcd2f56ea038c51b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986215:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003bfc0623/0xcd2f56ea038c51b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986224:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003bfc0623/0xcd2f56ea038c51b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986231:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003bfc0623/0xcd2f56ea038c51b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986335:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788652072.986692:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.986698:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c51be lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986708:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.986711:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.986715:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c51be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986723:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c51be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986732:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c51be lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986739:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c51be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986761:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788652072.986776:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788652072.986781:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003bfc0623/0xcd2f56ea038c51b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986789:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652072.986800:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003bfc0623/0xcd2f56ea038c51b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986811:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003bfc0623/0xcd2f56ea038c51b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986825:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003bfc0623/0xcd2f56ea038c51b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986832:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bfc0623/0xcd2f56ea038c51b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986848:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652072.986851:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c51be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986858:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652072.986862:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c51be lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986870:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c51be lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986879:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c51be lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.986973:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008bd73d44/0xcd2f56ea038c51be lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.987121:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652072.987124:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652072.987126:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.987381:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652072.988440:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.988449:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c51c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.988462:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.988466:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.988471:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c51c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.988485:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c51c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.988496:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c51c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.988504:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c51c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.988521:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652072.989173:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652072.989182:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c51c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.989192:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7200 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.989197:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c51c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.989207:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c51c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.989239:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c51c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.989247:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c877259/0xcd2f56ea038c51c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.989493:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.989495:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.989498:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652072.991640:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.991652:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c51cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.991692:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.991697:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.991703:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c51cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.991717:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c51cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.991728:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c51cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.991735:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c51cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.991761:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652072.992511:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652072.992520:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c51cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.992530:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.992535:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c51cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.992546:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c51cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.992639:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c51cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.992647:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6380126/0xcd2f56ea038c51cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.992690:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.992692:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.992694:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652072.996547:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.997386:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c51d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.997407:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.997412:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.997419:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c51d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.997435:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c51d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.997471:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c51d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.997479:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c51d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.997503:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652072.998366:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652072.998376:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c51d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.998387:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652072.998392:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c51d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.998403:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c51d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.998422:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c51d3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.998431:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c51d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652072.998459:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.998461:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652072.998463:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652072.998715:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652072.998721:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.998731:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652072.998736:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652072.998741:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.998753:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.998762:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.998770:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652072.998838:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788652073.000618:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652073.000632:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.000651:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652073.000656:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652073.000662:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.000688:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.000699:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.000707:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.004367:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788652073.004381:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.004408:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7c00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652073.004414:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.004426:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.004446:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.004454:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afcdb249/0xcd2f56ea038c51da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.004570:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788652073.004584:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652073.004589:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.004597:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652073.004607:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.004616:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.004628:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51e1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.004635:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c51e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.004650:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652073.004652:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652073.004654:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652073.004841:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652073.005302:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652073.005310:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c51e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.005325:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652073.005331:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652073.005339:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c51e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.005351:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c51e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.005361:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c51e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.005374:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c51e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.005396:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652073.005522:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652073.005528:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c51e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.005537:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652073.005541:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c51e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.005551:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c51e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.005584:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c51e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.005593:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a94e4bdb/0xcd2f56ea038c51e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.005607:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652073.005609:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652073.005611:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788652073.007499:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652073.007512:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c51ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.007527:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652073.007531:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652073.007537:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c51ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.007549:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c51ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.007569:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c51ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.007576:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c51ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.007600:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652073.007930:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652073.007938:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c51ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.007947:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:0.0:1788652073.007953:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c51ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.007963:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c51ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.007979:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c51ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.007987:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e557917/0xcd2f56ea038c51ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.008029:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652073.008031:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652073.008033:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652073.009837:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652073.009848:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c51f6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.009862:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788652073.009866:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652073.009873:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c51f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.009888:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c51f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.009899:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c51f6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.010022:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c51f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.010044:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788652073.010825:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652073.010833:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065835a49/0xcd2f56ea038c51fd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.010843:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788652073.010847:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652073.010852:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065835a49/0xcd2f56ea038c51fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.010874:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065835a49/0xcd2f56ea038c51fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.010885:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065835a49/0xcd2f56ea038c51fd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.010891:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065835a49/0xcd2f56ea038c51fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.010932:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788652073.011073:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652073.011080:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c51f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.011089:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907000 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652073.011093:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c51f6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.011103:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c51f6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.011122:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c51f6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.011142:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007ae5f41/0xcd2f56ea038c51f6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.011160:0:19250:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652073.011164:0:19250:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065835a49/0xcd2f56ea038c51fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.011171:0:19250:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652073.011174:0:19250:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065835a49/0xcd2f56ea038c51fd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.011182:0:19250:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065835a49/0xcd2f56ea038c51fd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.011193:0:19250:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065835a49/0xcd2f56ea038c51fd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.011200:0:19250:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065835a49/0xcd2f56ea038c51fd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.011211:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652073.011212:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652073.011214:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652073.011435:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788652073.011794:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652073.011801:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057fd5285/0xcd2f56ea038c5204 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.011811:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788652073.011814:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652073.011818:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057fd5285/0xcd2f56ea038c5204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.011828:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057fd5285/0xcd2f56ea038c5204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.011836:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057fd5285/0xcd2f56ea038c5204 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.011855:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057fd5285/0xcd2f56ea038c5204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.011922:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788652073.014651:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788652073.014664:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a431d3f/0xcd2f56ea038c520b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.014691:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=528s v=(0 0) 00010000:00010000:3.0:1788652073.014695:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652073.014702:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a431d3f/0xcd2f56ea038c520b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.014716:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a431d3f/0xcd2f56ea038c520b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.014727:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a431d3f/0xcd2f56ea038c520b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652073.014735:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a431d3f/0xcd2f56ea038c520b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.016863:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788652073.016876:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057fd5285/0xcd2f56ea038c5204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.016896:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f0907800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652073.016901:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057fd5285/0xcd2f56ea038c5204 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.016940:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057fd5285/0xcd2f56ea038c5204 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.016959:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057fd5285/0xcd2f56ea038c5204 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.016966:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057fd5285/0xcd2f56ea038c5204 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.017194:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652073.017201:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a431d3f/0xcd2f56ea038c520b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.017208:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:1.0:1788652073.017211:0:17175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a431d3f/0xcd2f56ea038c520b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.017218:0:17175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a431d3f/0xcd2f56ea038c520b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.017228:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a431d3f/0xcd2f56ea038c520b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652073.017241:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652073.017242:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652073.017244:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652073.018540:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652073.018660:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788652073.018670:0:18692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a431d3f/0xcd2f56ea038c520b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652073.021959:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788652073.021987:0:18692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5212 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.022006:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=528s v=(0 0) 00010000:00010000:2.0:1788652073.022011:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652073.022017:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.022031:0:18692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.022041:0:18692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5212 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.022048:0:18692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5212 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652073.022074:0:18692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788652073.022136:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788652073.022143:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5212 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.022151:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c7800 already unused, calling callback (ffffffffc0eb44f0) 00002000:00080000:2.0:1788652073.022155:0:18692:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00010000:00010000:0.0:1788652073.022156:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5212 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.022165:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5212 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.022179:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5212 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.022186:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d61336d7/0xcd2f56ea038c5212 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652073.022207:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652073.022209:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652073.022211:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652073.022260:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d51180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17213:x1875537147667584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 79739us (79813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652073.022269:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788652073.022372:0:17213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d50e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17213:1875537147667584:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788652073.022391:0:17213:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:0.0:1788652073.022452:0:17213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17213:1875537147668224:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788652073.022490:0:17213:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652073.022523:0:17213:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f4a47480 going to sleep for 11 seconds 00000100:00100000:2.0:1788652073.023186:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147668224 00000100:00100000:2.0:1788652073.023196:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147668224 00000100:00100000:2.0:1788652073.023245:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788652073.023255:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17213:x1875537147668224:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788652073.023292:0:18694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00000001:00080000:1.0:1788652073.029984:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788652073.030028:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788652073.030033:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788652073.030328:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17213:x1875537147668224:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6996us (7760us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788652073.030341:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788652073.030404:0:17213:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788652073.030414:0:17213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17213:1875537147668224:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788652073.030430:0:17213:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00000100:00100000:0.0:1788652073.034156:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17929:x1875537147668096:12345-0@lo:5:osp-pre-1-1.0 Request processed in 52685us (52909us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788652073.034169:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788652073.039211:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17929:1875537147668096:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788652073.039233:0:17929:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788652073.039289:0:17929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17929:1875537147668352:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788652073.039352:0:17929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652073.039389:0:17929:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c32b7300 going to sleep for 11 seconds 00000100:00100000:1.0:1788652073.039419:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147668352 00000100:00100000:1.0:1788652073.039424:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147668352 00000100:00100000:1.0:1788652073.039469:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788652073.039478:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17929:x1875537147668352:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788652073.039536:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17929:x1875537147668352:12345-0@lo:900:osp-pre-1-1.0 Request processed in 59us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652073.039544:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788652073.039582:0:17929:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86d1098380 x1875537147668352/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788652089 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652073.039592:0:17929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17929:1875537147668352:0@lo:900:osp-pre-1-1.0 00010000:00010000:1.0:1788652073.510608:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652073.952398:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788652073.952425:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147668480:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788652073.952881:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652073.952959:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147668480 00000100:00100000:0.0:1788652073.952971:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147668480 00000100:00100000:0.0:1788652073.953027:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788652073.953038:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147668480:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788652073.953064:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788652073.953130:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147668480:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652073.953137:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788652073.953200:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147668480:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788652074.541630:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652074.976751:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652074.976777:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147668608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788652074.976856:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652074.976923:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147668608 00000100:00100000:0.0:1788652074.976943:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147668608 00000100:00100000:0.0:1788652074.977094:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788652074.977111:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147668608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788652074.977148:0:18173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788652074.977199:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147668608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652074.977207:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788652074.977259:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147668608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788652074.977631:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788652074.977655:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147668736:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788652074.977696:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652074.977726:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147668736 00000100:00100000:1.0:1788652074.977730:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147668736 00000100:00100000:1.0:1788652074.977755:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788652074.977762:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147668736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652074.977782:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652074.977816:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147668736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652074.977822:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788652074.977848:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147668736:0@lo:41:osp-pre-1-0.0 00000001:02000400:0.0:1788652075.046523:0:19866:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg445-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788652075.552611:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788652075.879679:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788652076.038358:0:19918:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788652076.039064:0:19918:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788652076.576171:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788652076.998497:0:19968:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788652076.998757:0:19968:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788652077.291093:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652077.291237:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125560192 00000100:00100000:1.0:1788652077.291248:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125560192 00000100:00100000:1.0:1788652077.291328:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 116 00000100:00100000:1.0:1788652077.291337:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2387:x1875537125560192:12345-192.168.204.45@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788652077.291368:0:17179:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d@192.168.204.45@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:1.0:1788652077.291396:0:17179:0:(genops.c:1385:class_connect()) connect: client b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d, cookie 0xcd2f56ea038c5219 00000100:00080000:1.0:1788652077.291536:0:17179:0:(import.c:65:import_set_state_nolock()) ffff8f85c3e6e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652077.291629:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6692c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+5:2387:x1875537125560192:12345-192.168.204.45@tcp:250:mount.lustre.0 Request processed in 291us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652077.291637:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 116 00000100:00100000:1.0:1788652077.300946:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652077.301044:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125560320 00000100:00100000:3.0:1788652077.301054:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125560320 00000100:00100000:3.0:1788652077.301102:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 117 00000100:00100000:3.0:1788652077.301111:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+5:14917:x1875537125560320:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788652077.301126:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652077.301143:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86c1502800/0xcd2f56ea038c5220 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33fec expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652077.301170:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86c1502800/0xcd2f56ea038c5220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fec expref: 6 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652077.301180:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86c1502800/0xcd2f56ea038c5220 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33fec expref: 6 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652077.301189:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502800, rc 0) 00000100:00100000:3.0:1788652077.301248:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+6:14917:x1875537125560320:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 139us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652077.301255:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 117 00000100:00100000:2.0:1788652077.304538:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652077.304847:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125560448 00000100:00100000:1.0:1788652077.304858:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125560448 00000100:00100000:1.0:1788652077.304951:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 118 00000100:00100000:1.0:1788652077.304961:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+6:14917:x1875537125560448:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788652077.305095:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+6:14917:x1875537125560448:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 134us (567us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788652077.305103:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 118 00000100:00100000:2.0:1788652077.307981:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652077.308078:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125560576 00000100:00100000:0.0:1788652077.308089:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125560576 00000100:00100000:0.0:1788652077.308144:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 119 00000100:00100000:0.0:1788652077.308154:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+6:14917:x1875537125560576:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788652077.308171:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652077.308190:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c5227 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe33ff3 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652077.308224:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c5227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ff3 expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652077.308236:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da5600/0xcd2f56ea038c5227 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe33ff3 expref: 7 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652077.308246:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5600, rc 0) 00000100:00100000:0.0:1788652077.308327:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+7:14917:x1875537125560576:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 173us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652077.308356:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 119 00000100:00100000:2.0:1788652077.310445:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652077.310502:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125560704 00000100:00100000:3.0:1788652077.310512:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125560704 00000100:00100000:3.0:1788652077.310561:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 120 00000100:00100000:3.0:1788652077.310570:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+7:14917:x1875537125560704:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788652077.310728:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+8:14917:x1875537125560704:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 158us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652077.310749:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 120 00000100:00100000:2.0:1788652077.312254:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652077.312509:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125560832 00000100:00100000:1.0:1788652077.312518:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125560832 00000100:00100000:1.0:1788652077.312569:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 121 00000100:00100000:1.0:1788652077.312579:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+8:14917:x1875537125560832:12345-192.168.204.45@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788652077.312883:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+8:14917:x1875537125560832:12345-192.168.204.45@tcp:503:mount.lustre.0 Request processed in 304us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652077.312892:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 121 00000100:00100000:2.0:1788652077.320967:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652077.321080:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125560960 00000100:00100000:3.0:1788652077.321091:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125560960 00000100:00100000:3.0:1788652077.321148:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 122 00000100:00100000:3.0:1788652077.321158:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+8:14936:x1875537125560960:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788652077.321327:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+8:14936:x1875537125560960:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 170us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652077.321335:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 122 00000100:00100000:2.0:1788652077.357378:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652077.358519:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125561088 00000100:00100000:1.0:1788652077.358532:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125561088 00000100:00100000:1.0:1788652077.358653:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 123 00000100:00100000:1.0:1788652077.358663:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+8:14936:x1875537125561088:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788652077.358828:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+8:14936:x1875537125561088:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 165us (1459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652077.358837:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 123 00000100:00100000:0.0:1788652077.364984:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652077.366669:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125561216 00000100:00100000:3.0:1788652077.366684:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125561216 00000100:00100000:3.0:1788652077.366808:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 124 00000100:00100000:3.0:1788652077.366820:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+8:14936:x1875537125561216:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652077.367101:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+8:14936:x1875537125561216:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 282us (2129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652077.367110:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 124 00000100:00100000:2.0:1788652077.371051:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652077.371702:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125561344 00000100:00100000:1.0:1788652077.371719:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125561344 00000100:00100000:1.0:1788652077.371870:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 125 00000100:00100000:1.0:1788652077.371881:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+8:14917:x1875537125561344:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788652077.372026:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652077.372048:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f9800/0xcd2f56ea038c522e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34024 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.372100:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f9800/0xcd2f56ea038c522e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34024 expref: 9 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.372111:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f9800/0xcd2f56ea038c522e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34024 expref: 9 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.372121:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f9800, rc 0) 00000100:00100000:1.0:1788652077.372186:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+9:14917:x1875537125561344:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 307us (2174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652077.372194:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 125 00000100:00100000:1.0:1788652077.376021:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652077.376173:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125561472 00000100:00100000:2.0:1788652077.376186:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125561472 00000100:00100000:2.0:1788652077.376256:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 126 00000100:00100000:2.0:1788652077.376267:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+9:14917:x1875537125561472:12345-192.168.204.45@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788652077.376300:0:17182:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788652077.376332:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788652077.376337:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788652077.376340:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788652077.376343:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788652077.376345:0:17182:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788652077.379742:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+9:14917:x1875537125561472:12345-192.168.204.45@tcp:256:mount.lustre.0 Request processed in 3465us (3720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652077.379758:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 126 00000100:00100000:2.0:1788652077.382729:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652077.382808:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125561600 00000100:00100000:1.0:1788652077.382819:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125561600 00000100:00100000:1.0:1788652077.382939:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 127 00000100:00100000:1.0:1788652077.382950:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fcb4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+9:14917:x1875537125561600:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788652077.382970:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652077.382988:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c5235 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3402b expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.383126:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c5235 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3402b expref: 10 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.383140:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c5235 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3402b expref: 10 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.383150:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f87021f8600, rc 0) 00000100:00100000:1.0:1788652077.383201:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fcb4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:14917:x1875537125561600:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 253us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652077.383221:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 127 00000100:00100000:2.0:1788652077.385096:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652077.385650:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125561728 00000100:00100000:0.0:1788652077.385663:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125561728 00000100:00100000:0.0:1788652077.385716:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 128 00000100:00100000:0.0:1788652077.385725:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:14917:x1875537125561728:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788652077.385943:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:14917:x1875537125561728:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 219us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652077.385952:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 128 00000100:00100000:0.0:1788652077.388552:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652077.388654:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125561856 00000100:00100000:3.0:1788652077.388664:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125561856 00000100:00100000:3.0:1788652077.388716:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 129 00000100:00100000:3.0:1788652077.388727:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:14917:x1875537125561856:12345-192.168.204.45@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788652077.388879:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6764c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:14917:x1875537125561856:12345-192.168.204.45@tcp:503:mount.lustre.0 Request processed in 153us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652077.388887:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 129 00000100:00100000:2.0:1788652077.395394:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652077.395534:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125561984 00000100:00100000:0.0:1788652077.395544:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125561984 00000100:00100000:0.0:1788652077.395611:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 130 00000100:00100000:0.0:1788652077.395621:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:14941:x1875537125561984:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788652077.395811:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:14941:x1875537125561984:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 191us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652077.395820:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 130 00000100:00100000:2.0:1788652077.408077:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652077.408170:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125562112 00000100:00100000:1.0:1788652077.408180:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125562112 00000100:00100000:1.0:1788652077.408239:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 131 00000100:00100000:1.0:1788652077.408248:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:14941:x1875537125562112:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788652077.408411:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6766050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:14941:x1875537125562112:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 163us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652077.408420:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 131 00000100:00100000:2.0:1788652077.421536:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652077.421968:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652077.422105:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125562240 00000100:00100000:0.0:1788652077.422120:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125562240 00000100:00100000:0.0:1788652077.422169:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125562496 00000100:00100000:0.0:1788652077.422173:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125562496 00000100:00100000:0.0:1788652077.422208:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:0.0:1788652077.422219:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2387:x1875537125562240:12345-192.168.204.45@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788652077.422255:0:17187:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 13cd7710-0d0a-4bf8-8621-85bf9f039118@192.168.204.45@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1788652077.422313:0:17187:0:(genops.c:1385:class_connect()) connect: client 13cd7710-0d0a-4bf8-8621-85bf9f039118, cookie 0xcd2f56ea038c523c 00000004:00100000:0.0:1788652077.422353:0:17187:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788652077.422597:0:17187:0:(import.c:65:import_set_state_nolock()) ffff8f86f3d22800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652077.422680:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2387:x1875537125562240:12345-192.168.204.45@tcp:38:mount.lustre.0 Request processed in 462us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652077.422689:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:0.0:1788652077.422709:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:0.0:1788652077.422714:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2387:x1875537125562496:12345-192.168.204.45@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788652077.422730:0:17187:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 13cd7710-0d0a-4bf8-8621-85bf9f039118@192.168.204.45@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1788652077.422762:0:17187:0:(genops.c:1385:class_connect()) connect: client 13cd7710-0d0a-4bf8-8621-85bf9f039118, cookie 0xcd2f56ea038c5243 00000004:00100000:0.0:1788652077.422773:0:17187:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788652077.423064:0:17187:0:(import.c:65:import_set_state_nolock()) ffff8f86f3d25800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652077.423089:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2387:x1875537125562496:12345-192.168.204.45@tcp:38:mount.lustre.0 Request processed in 374us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652077.423096:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:2.0:1788652077.434363:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652077.434412:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652077.434439:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652077.434513:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125562752 00000100:00100000:3.0:1788652077.434523:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125562752 00000100:00100000:3.0:1788652077.434607:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125562624 00000100:00100000:3.0:1788652077.434610:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125562624 00000100:00100000:3.0:1788652077.434628:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125562368 00000100:00100000:3.0:1788652077.434631:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125562368 00000100:00100000:3.0:1788652077.434646:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:3.0:1788652077.434655:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:14917:x1875537125562752:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788652077.434694:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788652077.434780:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:14917:x1875537125562752:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 125us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652077.434787:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:3.0:1788652077.434804:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:3.0:1788652077.434811:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:0:x1875537125562624:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788652077.434828:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788652077.434864:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:0:x1875537125562624:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 53us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652077.434870:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:3.0:1788652077.434881:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:3.0:1788652077.434886:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:0:x1875537125562368:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788652077.434896:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788652077.434947:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:0:x1875537125562368:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 60us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652077.434952:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00080000:2.0:1788652077.435561:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788652077.435566:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652077.437031:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652077.437120:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125562880 00000100:00100000:3.0:1788652077.437131:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125562880 00000100:00100000:3.0:1788652077.437197:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 12 00000100:00100000:3.0:1788652077.437207:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:14917:x1875537125562880:12345-192.168.204.45@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788652077.437306:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:14917:x1875537125562880:12345-192.168.204.45@tcp:40:mount.lustre.0 Request processed in 100us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652077.437314:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 12 00000100:00100000:3.0:1788652077.439562:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652077.439611:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652077.439687:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652077.439790:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125563008 00000100:00100000:0.0:1788652077.439801:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125563008 00000100:00100000:0.0:1788652077.439847:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125563136 00000100:00100000:0.0:1788652077.439850:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125563136 00000100:00100000:0.0:1788652077.439871:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:0.0:1788652077.439880:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1875537125563008:12345-192.168.204.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788652077.439950:0:18693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 13cd7710-0d0a-4bf8-8621-85bf9f039118@192.168.204.45@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1788652077.439984:0:18693:0:(genops.c:1385:class_connect()) connect: client 13cd7710-0d0a-4bf8-8621-85bf9f039118, cookie 0xcd2f56ea038c524a 00002000:00100000:0.0:1788652077.439995:0:18693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 13cd7710-0d0a-4bf8-8621-85bf9f039118/ffff8f86f3d20800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788652077.440017:0:18693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788652077.440196:0:18693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788652077.440228:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8f86f3d25000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652077.440283:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2387:x1875537125563008:12345-192.168.204.45@tcp:8:mount.lustre.0 Request processed in 403us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652077.440290:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:0.0:1788652077.440308:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:0.0:1788652077.440313:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1875537125563136:12345-192.168.204.45@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788652077.440327:0:18693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 13cd7710-0d0a-4bf8-8621-85bf9f039118@192.168.204.45@tcp t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1788652077.440342:0:18693:0:(genops.c:1385:class_connect()) connect: client 13cd7710-0d0a-4bf8-8621-85bf9f039118, cookie 0xcd2f56ea038c5251 00002000:00100000:0.0:1788652077.440347:0:18693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 13cd7710-0d0a-4bf8-8621-85bf9f039118/ffff8f86f3d27000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788652077.440357:0:18693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788652077.440448:0:18693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788652077.440462:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8f86f3d21800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652077.440482:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2387:x1875537125563136:12345-192.168.204.45@tcp:8:mount.lustre.0 Request processed in 169us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652077.440489:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:1.0:1788652077.440839:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125563264 00000100:00100000:1.0:1788652077.440845:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125563264 00000100:00100000:1.0:1788652077.440884:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:1.0:1788652077.440892:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:14917:x1875537125563264:12345-192.168.204.45@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788652077.440962:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:14917:x1875537125563264:12345-192.168.204.45@tcp:900:mount.lustre.0 Request processed in 71us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652077.440969:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:3.0:1788652077.445285:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652077.446537:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125563392 00000100:00100000:0.0:1788652077.446551:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125563392 00000100:00100000:0.0:1788652077.446619:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:0.0:1788652077.446629:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:14917:x1875537125563392:12345-192.168.204.45@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788652077.457846:0:17189:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 11126us 00000004:00200000:3.0:1788652077.476510:0:17189:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788652077.476657:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:14917:x1875537125563392:12345-192.168.204.45@tcp:33:mount.lustre.0 Request processed in 30024us (31376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652077.476673:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 0 00010000:00010000:2.0:1788652077.601292:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652077.697761:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652077.697942:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125563520 00000100:00100000:1.0:1788652077.697953:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125563520 00000100:00100000:1.0:1788652077.698024:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:1.0:1788652077.698034:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:14964:x1875537125563520:12345-192.168.204.45@tcp:101:mkdir.0 00010000:00010000:1.0:1788652077.698056:0:19248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652077.698083:0:19248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c5258 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3405c expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.698145:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c525f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.698173:0:19248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c525f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.698189:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c525f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652077.698242:0:19248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788652077.698246:0:19248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788652077.698282:0:19248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c525f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.698310:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907400/0xcd2f56ea038c5258 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3405c expref: 8 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.698329:0:19248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c525f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3405c expref: 7 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652077.698337:0:19248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374e00) 00010000:00010000:1.0:1788652077.698340:0:19248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652077.698343:0:19248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907000, rc 0) 00000100:00100000:1.0:1788652077.698536:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:14964:x1875537125563520:12345-192.168.204.45@tcp:101:mkdir.0 Request processed in 502us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652077.698543:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:2.0:1788652078.048336:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147669120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788652078.048367:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147669248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652078.048410:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652078.048444:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147669120 00000100:00100000:0.0:1788652078.048453:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147669120 00000100:00080000:2.0:1788652078.048513:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652078.048522:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788652078.048527:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652078.048537:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147669120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788652078.049705:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788652078.049778:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147669120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1246us (1368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652078.049786:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788652078.049811:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147669248 00000100:00100000:0.0:1788652078.049817:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147669248 00000100:00100000:0.0:1788652078.049851:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788652078.049859:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147669248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788652078.049869:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788652078.049925:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147669248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652078.049931:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788652078.050036:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652078.050055:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147669760:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.050091:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652078.050147:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147669248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652078.050170:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788652078.050175:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147669632:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.050196:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652078.050217:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147670144:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.050244:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652078.050252:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147669376:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.050265:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147670272:0@lo:400:kworker.0 00000100:00100000:3.0:1788652078.050289:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652078.050308:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652078.050328:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147669888:0@lo:400:kworker.0 00000100:00100000:3.0:1788652078.050359:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652078.050360:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147669632 00000100:00100000:2.0:1788652078.050366:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147669632 00000100:00100000:3.0:1788652078.050380:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147670400:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.050397:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147669376 00000100:00100000:2.0:1788652078.050400:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147669376 00000100:00100000:2.0:1788652078.050418:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788652078.050424:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652078.050430:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147669632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.050469:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147669632:12345-0@lo:400:kworker.0 Request processed in 42us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652078.050474:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788652078.050485:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788652078.050489:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147669376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.050510:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147669376:12345-0@lo:400:kworker.0 Request processed in 21us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652078.050515:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788652078.050866:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147669376:0@lo:400:kworker.0 00000100:00100000:3.0:1788652078.050879:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 5 async RPCs [3->2] 00000100:00100000:3.0:1788652078.050886:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147668992:0@lo:400:kworker.0 00000100:00100000:3.0:1788652078.050942:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652078.050966:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147668864:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788652078.051228:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652078.051249:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147669504:0@lo:400:kworker.0 00000100:00100000:3.0:1788652078.051280:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652078.051342:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147670016:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.051343:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147670144 00000100:00100000:2.0:1788652078.051350:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147670144 00000100:00100000:3.0:1788652078.051370:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652078.051386:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147670272 00000100:00100000:2.0:1788652078.051389:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147670272 00000100:00100000:2.0:1788652078.051399:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147670400 00000100:00100000:2.0:1788652078.051402:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147670400 00000100:00100000:2.0:1788652078.051413:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147669504 00000100:00100000:2.0:1788652078.051415:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147669504 00000100:00100000:2.0:1788652078.051434:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147670016 00000100:00100000:2.0:1788652078.051436:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147670016 00000100:00100000:2.0:1788652078.051449:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788652078.051455:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147670144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.051487:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147670144:12345-0@lo:400:kworker.0 Request processed in 32us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652078.051493:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788652078.051511:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788652078.051516:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147670272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.051538:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147670272:12345-0@lo:400:kworker.0 Request processed in 22us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652078.051543:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788652078.052349:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147670528:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.052382:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788652078.052396:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147670400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652078.052423:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652078.052492:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147669760 00000100:00100000:0.0:1788652078.052501:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147669760 00000100:00100000:0.0:1788652078.052538:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147669888 00000100:00100000:0.0:1788652078.052542:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147669888 00000100:00100000:0.0:1788652078.052590:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788652078.052597:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147669760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.052652:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147670400:12345-0@lo:400:kworker.0 Request processed in 261us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652078.052659:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788652078.052670:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147670400:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.052676:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147670528 00000100:00100000:2.0:1788652078.052680:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147670528 00000100:00100000:2.0:1788652078.052702:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788652078.052708:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147669504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652078.052771:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788652078.052803:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788652078.052814:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147670016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652078.053252:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1875537147669888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652078.057455:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147669760:12345-0@lo:400:kworker.0 Request processed in 4849us (7353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652078.057472:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788652078.057570:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652078.057755:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652078.057760:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788652078.057763:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652078.057823:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147669120:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1788652078.058265:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3cbe300 x1875537147670272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652078.058294:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147670272:0@lo:400:kworker.0 00000100:00100000:0.0:1788652078.058309:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147669632:0@lo:400:kworker.0 00000100:00100000:0.0:1788652078.058323:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147670144:0@lo:400:kworker.0 00000100:00100000:0.0:1788652078.058335:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147669760:0@lo:400:kworker.0 00000100:00100000:0.0:1788652078.058382:0:17188:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788652078.058391:0:17188:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:0.0:1788652078.058483:0:17187:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:0.0:1788652078.058495:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788652078.058506:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147670528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.059183:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3637:x1875537147669504:12345-0@lo:400:kworker.0 Request processed in 6470us (7897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652078.059192:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788652078.059300:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147670016:12345-0@lo:400:kworker.0 Request processed in 6487us (7929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652078.059308:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788652078.059503:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147668864 00000100:00100000:1.0:1788652078.059511:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147668864 00000100:00100000:1.0:1788652078.059541:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652078.059548:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3637:x1875537147668864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788652078.059565:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788652078.059789:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff463100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3637:x1875537147668864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 241us (8560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652078.059796:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788652078.059817:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147668992 00000100:00100000:1.0:1788652078.059820:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147668992 00000100:00100000:1.0:1788652078.060098:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788652078.060106:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3637:x1875537147668992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652078.060378:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3637:x1875537147668992:12345-0@lo:400:kworker.0 Request processed in 272us (9435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652078.060385:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788652078.061052:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3637:1875537147669504:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.061078:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147670016:0@lo:400:kworker.0 00000100:00100000:3.0:1788652078.061349:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff461500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3637:x1875537147669888:12345-0@lo:400:kworker.0 Request processed in 8101us (10988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652078.061360:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788652078.066030:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff462d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147670528:12345-0@lo:400:kworker.0 Request processed in 7508us (13591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652078.066045:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788652078.067649:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c3cbed80 x1875537147670528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788652078.067668:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147670528:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.067688:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147669888:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.067724:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a28e2822-101e-46fe-b9c1-7a60e90536a9:3637:1875537147668992:0@lo:400:kworker.0 00000100:00100000:2.0:1788652078.067767:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d1098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147668864:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788652078.624221:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652079.074353:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147670656:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788652079.074467:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652079.077457:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147670656 00000100:00100000:3.0:1788652079.077474:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147670656 00000100:00100000:3.0:1788652079.077567:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788652079.077579:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147670656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788652079.077616:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788652079.077705:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147670656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (3238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652079.077713:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788652079.078104:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86eeb51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147670656:0@lo:13:osp-pre-0-1.0 00000001:00100000:2.0:1788652079.086371:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 13cd7710-0d0a-4bf8-8621-85bf9f039118 00000001:00080000:2.0:1788652079.086387:0:19510:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000040:00080000:1.0:1788652079.328838:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788652079.648587:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788652080.008070:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652080.009253:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125563648 00000100:00100000:0.0:1788652080.009266:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125563648 00000100:00100000:0.0:1788652080.009357:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:0.0:1788652080.009367:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:15016:x1875537125563648:12345-192.168.204.45@tcp:41:lfs.0 00000004:00000024:0.0:1788652080.009409:0:19248:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788652080.009502:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff460380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:15016:x1875537125563648:12345-192.168.204.45@tcp:41:lfs.0 Request processed in 137us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652080.009528:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00080000:2.0:1788652080.009623:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652080.022760:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652080.022885:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125563776 00000100:00100000:1.0:1788652080.022896:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125563776 00000100:00080000:2.0:1788652080.023088:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788652080.023535:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:1.0:1788652080.023561:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:15016:x1875537125563776:12345-192.168.204.45@tcp:41:lfs.0 00000004:00000024:1.0:1788652080.023604:0:19982:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652080.023701:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:15016:x1875537125563776:12345-192.168.204.45@tcp:41:lfs.0 Request processed in 145us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.023709:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:2.0:1788652080.031202:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652080.032192:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125563904 00000100:00100000:1.0:1788652080.032207:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125563904 00000100:00100000:1.0:1788652080.032417:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:1.0:1788652080.032446:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:15016:x1875537125563904:12345-192.168.204.45@tcp:13:lfs.0 00002000:00000024:1.0:1788652080.032495:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788652080.032612:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:15016:x1875537125563904:12345-192.168.204.45@tcp:13:lfs.0 Request processed in 168us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.032625:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:3.0:1788652080.041503:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652080.042491:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125564032 00000100:00100000:0.0:1788652080.042504:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125564032 00000100:00080000:2.0:1788652080.047465:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652080.047478:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652080.057719:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:0.0:1788652080.057745:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:15016:x1875537125564032:12345-192.168.204.45@tcp:13:lfs.0 00002000:00000024:0.0:1788652080.057787:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788652080.057901:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:15016:x1875537125564032:12345-192.168.204.45@tcp:13:lfs.0 Request processed in 167us (16412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652080.057923:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:0.0:1788652080.096724:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147670784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788652080.096802:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652080.097195:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147670912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788652080.097232:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652080.097341:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147670784 00000100:00100000:1.0:1788652080.097349:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147670784 00000100:00100000:1.0:1788652080.097404:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147670912 00000100:00100000:1.0:1788652080.097407:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147670912 00000100:00100000:1.0:1788652080.097424:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788652080.097432:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147670784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652080.097469:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652080.097520:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147670784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.097526:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788652080.097555:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788652080.097561:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147670912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788652080.097579:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788652080.097610:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147670912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 49us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.097616:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788652080.097776:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147670912:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788652080.098165:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147670784:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788652080.321566:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652080.321964:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125564160 00000100:00100000:2.0:1788652080.321990:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125564160 00000100:00100000:2.0:1788652080.322122:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 133 00000100:00100000:2.0:1788652080.322133:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+10:15047:x1875537125564160:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788652080.322151:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652080.322173:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c5266 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34063 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652080.322204:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c5266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34063 expref: 11 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652080.322215:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c6c00/0xcd2f56ea038c5266 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34063 expref: 11 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652080.322239:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6c00, rc 0) 00000100:00100000:2.0:1788652080.322309:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6766450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15047:x1875537125564160:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 178us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652080.322332:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 133 00000100:00100000:3.0:1788652080.333102:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652080.351772:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125564288 00000100:00100000:1.0:1788652080.351788:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125564288 00000100:00100000:1.0:1788652080.351869:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 134 00000100:00100000:1.0:1788652080.351881:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15047:x1875537125564288:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788652080.352130:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6765c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15047:x1875537125564288:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 251us (19039us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.352159:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 134 00000100:00100000:3.0:1788652080.371304:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652080.371449:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125564416 00000100:00100000:1.0:1788652080.371462:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125564416 00000100:00100000:1.0:1788652080.371527:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 135 00000100:00100000:1.0:1788652080.371549:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15047:x1875537125564416:12345-192.168.204.45@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788652080.371712:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6767450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15047:x1875537125564416:12345-192.168.204.45@tcp:503:mount.lustre.0 Request processed in 164us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.371720:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 135 00000100:00100000:3.0:1788652080.389812:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652080.390151:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125564544 00000100:00100000:0.0:1788652080.390163:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125564544 00000100:00100000:0.0:1788652080.390238:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 136 00000100:00100000:0.0:1788652080.390248:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15055:x1875537125564544:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788652080.390450:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15055:x1875537125564544:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 202us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652080.390458:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 136 00000100:00100000:3.0:1788652080.424104:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652080.424181:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125564672 00000100:00100000:2.0:1788652080.424192:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125564672 00000100:00100000:2.0:1788652080.424265:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 137 00000100:00100000:2.0:1788652080.424276:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15055:x1875537125564672:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788652080.424421:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15055:x1875537125564672:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 146us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652080.424429:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 137 00000100:00100000:3.0:1788652080.431706:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652080.433521:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125564800 00000100:00100000:0.0:1788652080.433548:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125564800 00000100:00100000:0.0:1788652080.433628:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 138 00000100:00100000:0.0:1788652080.433640:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15055:x1875537125564800:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788652080.433834:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15055:x1875537125564800:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 196us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652080.433852:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 138 00000100:00100000:3.0:1788652080.439485:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652080.440636:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125564928 00000100:00100000:1.0:1788652080.440650:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125564928 00000100:00100000:1.0:1788652080.440705:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 139 00000100:00100000:1.0:1788652080.440716:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:15047:x1875537125564928:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788652080.440734:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652080.440755:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f0907400/0xcd2f56ea038c526d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34094 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.440786:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f0907400/0xcd2f56ea038c526d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34094 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.440797:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f0907400/0xcd2f56ea038c526d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34094 expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.440806:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907400, rc 0) 00000100:00100000:1.0:1788652080.447385:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:15047:x1875537125564928:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 6657us (7895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.447399:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 139 00000100:00100000:3.0:1788652080.454400:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652080.455660:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125565056 00000100:00100000:2.0:1788652080.455673:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125565056 00000100:00100000:2.0:1788652080.455741:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 140 00000100:00100000:2.0:1788652080.455754:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:15047:x1875537125565056:12345-192.168.204.45@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788652080.455783:0:17182:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788652080.455809:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788652080.455813:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788652080.455817:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788652080.455820:0:17182:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1788652080.455822:0:17182:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:2.0:1788652080.457996:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:15047:x1875537125565056:12345-192.168.204.45@tcp:256:mount.lustre.0 Request processed in 2233us (3599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652080.458010:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 140 00000100:00100000:3.0:1788652080.468966:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652080.469476:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125565184 00000100:00100000:1.0:1788652080.469486:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125565184 00000100:00100000:1.0:1788652080.469554:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 141 00000100:00100000:1.0:1788652080.469566:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:15047:x1875537125565184:12345-192.168.204.45@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788652080.469583:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652080.469603:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86f0907800/0xcd2f56ea038c5274 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3409b expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.469636:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86f0907800/0xcd2f56ea038c5274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3409b expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.469648:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86f0907800/0xcd2f56ea038c5274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3409b expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.469657:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86f0907800, rc 0) 00000100:00100000:1.0:1788652080.469723:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:15047:x1875537125565184:12345-192.168.204.45@tcp:101:mount.lustre.0 Request processed in 159us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.469731:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 141 00000100:00100000:3.0:1788652080.472276:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652080.472770:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125565312 00000100:00100000:2.0:1788652080.472781:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125565312 00000100:00100000:2.0:1788652080.472841:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 142 00000100:00100000:2.0:1788652080.472855:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:15047:x1875537125565312:12345-192.168.204.45@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788652080.473093:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:15047:x1875537125565312:12345-192.168.204.45@tcp:501:mount.lustre.0 Request processed in 240us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652080.473101:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 142 00000100:00100000:3.0:1788652080.475643:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652080.475717:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125565440 00000100:00100000:0.0:1788652080.475728:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125565440 00000100:00100000:0.0:1788652080.475789:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 143 00000100:00100000:0.0:1788652080.475801:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:15047:x1875537125565440:12345-192.168.204.45@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788652080.475992:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:15047:x1875537125565440:12345-192.168.204.45@tcp:503:mount.lustre.0 Request processed in 193us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652080.476009:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 143 00000100:00100000:2.0:1788652080.483988:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652080.484400:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125565568 00000100:00100000:1.0:1788652080.484414:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125565568 00000100:00100000:1.0:1788652080.484476:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 144 00000100:00100000:1.0:1788652080.484488:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:15061:x1875537125565568:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788652080.484687:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:15061:x1875537125565568:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 200us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.484697:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 144 00000100:00100000:2.0:1788652080.496582:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652080.496764:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125565696 00000100:00100000:0.0:1788652080.496777:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125565696 00000100:00100000:0.0:1788652080.496858:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 145 00000100:00100000:0.0:1788652080.496869:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:15061:x1875537125565696:12345-192.168.204.45@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788652080.497310:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:15061:x1875537125565696:12345-192.168.204.45@tcp:502:llog_process_th.0 Request processed in 440us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652080.497320:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 145 00000100:00100000:2.0:1788652080.510003:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652080.510138:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125565824 00000100:00100000:0.0:1788652080.510149:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125565824 00000100:00100000:0.0:1788652080.510198:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:0.0:1788652080.510206:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2387:x1875537125565824:12345-192.168.204.45@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788652080.510246:0:17187:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f6da5325-c43d-45b2-9745-228d7048f21f@192.168.204.45@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:0.0:1788652080.510293:0:17187:0:(genops.c:1385:class_connect()) connect: client f6da5325-c43d-45b2-9745-228d7048f21f, cookie 0xcd2f56ea038c527b 00000004:00100000:0.0:1788652080.510317:0:17187:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788652080.510430:0:17187:0:(import.c:65:import_set_state_nolock()) ffff8f85c32c9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788652080.510502:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86eeb50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6da5325-c43d-45b2-9745-228d7048f21f+6:2387:x1875537125565824:12345-192.168.204.45@tcp:38:mount.lustre.0 Request processed in 295us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652080.510510:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:2.0:1788652080.511168:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652080.516610:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125566080 00000100:00100000:1.0:1788652080.516627:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125566080 00000100:00100000:1.0:1788652080.517142:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:1.0:1788652080.517151:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2387:x1875537125566080:12345-192.168.204.45@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788652080.517184:0:17188:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from f6da5325-c43d-45b2-9745-228d7048f21f@192.168.204.45@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:1.0:1788652080.517292:0:17188:0:(genops.c:1385:class_connect()) connect: client f6da5325-c43d-45b2-9745-228d7048f21f, cookie 0xcd2f56ea038c5282 00000004:00100000:1.0:1788652080.517319:0:17188:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788652080.517563:0:17188:0:(import.c:65:import_set_state_nolock()) ffff8f86c3595800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788652080.518865:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+6:2387:x1875537125566080:12345-192.168.204.45@tcp:38:mount.lustre.0 Request processed in 1704us (7689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.518878:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:3.0:1788652080.534743:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652080.534792:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652080.535278:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125565952 00000100:00100000:0.0:1788652080.535291:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125565952 00000100:00100000:0.0:1788652080.535379:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125566336 00000100:00100000:0.0:1788652080.535383:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125566336 00000100:00100000:0.0:1788652080.535409:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:0.0:1788652080.535418:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+7:0:x1875537125565952:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788652080.535450:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788652080.535515:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+7:0:x1875537125565952:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 98us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652080.535523:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:0.0:1788652080.535555:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:0.0:1788652080.535562:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+6:15047:x1875537125566336:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788652080.535573:0:17186:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788652080.535595:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+6:15047:x1875537125566336:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 34us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652080.535600:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00080000:2.0:1788652080.537046:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788652080.542610:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652080.542672:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652080.542854:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125566464 00000100:00100000:1.0:1788652080.542866:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125566464 00000100:00100000:1.0:1788652080.542959:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125566208 00000100:00100000:1.0:1788652080.542963:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125566208 00000100:00100000:1.0:1788652080.542998:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:1.0:1788652080.543008:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+6:15047:x1875537125566464:12345-192.168.204.45@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788652080.543094:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+6:15047:x1875537125566464:12345-192.168.204.45@tcp:40:mount.lustre.0 Request processed in 87us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.543102:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:1.0:1788652080.543125:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:1.0:1788652080.543132:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+6:0:x1875537125566208:12345-192.168.204.45@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788652080.543144:0:17188:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652080.543173:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+6:0:x1875537125566208:12345-192.168.204.45@tcp:41:mount.lustre.0 Request processed in 43us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.543179:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00080000:3.0:1788652080.543381:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788652080.549677:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652080.549721:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652080.549759:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652080.549963:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125566592 00000100:00100000:3.0:1788652080.549974:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125566592 00000100:00100000:3.0:1788652080.550023:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125566720 00000100:00100000:3.0:1788652080.550027:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125566720 00000100:00100000:3.0:1788652080.550059:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:3.0:1788652080.550069:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1875537125566592:12345-192.168.204.45@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788652080.550107:0:18693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f6da5325-c43d-45b2-9745-228d7048f21f@192.168.204.45@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:3.0:1788652080.550158:0:18693:0:(genops.c:1385:class_connect()) connect: client f6da5325-c43d-45b2-9745-228d7048f21f, cookie 0xcd2f56ea038c5289 00002000:00100000:3.0:1788652080.550173:0:18693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f6da5325-c43d-45b2-9745-228d7048f21f/ffff8f85c3090800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788652080.550185:0:18693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788652080.551076:0:18693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788652080.551405:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8f85c3095800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652080.551488:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+6:2387:x1875537125566592:12345-192.168.204.45@tcp:8:mount.lustre.0 Request processed in 1419us (1765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652080.551498:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:3.0:1788652080.551543:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:3.0:1788652080.551566:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2387:x1875537125566720:12345-192.168.204.45@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788652080.551590:0:18693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f6da5325-c43d-45b2-9745-228d7048f21f@192.168.204.45@tcp t0 exp 0000000000000000 cur 536 last 0 00000020:00000080:3.0:1788652080.551614:0:18693:0:(genops.c:1385:class_connect()) connect: client f6da5325-c43d-45b2-9745-228d7048f21f, cookie 0xcd2f56ea038c5290 00002000:00100000:3.0:1788652080.551625:0:18693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f6da5325-c43d-45b2-9745-228d7048f21f/ffff8f85c3091000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788652080.551634:0:18693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788652080.551689:0:18693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788652080.551704:0:18693:0:(import.c:65:import_set_state_nolock()) ffff8f85c3092800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788652080.551727:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+6:2387:x1875537125566720:12345-192.168.204.45@tcp:8:mount.lustre.0 Request processed in 162us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652080.551735:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:1.0:1788652080.553784:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125566848 00000100:00100000:1.0:1788652080.553831:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125566848 00000100:00100000:1.0:1788652080.553950:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:1.0:1788652080.553962:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f6da5325-c43d-45b2-9745-228d7048f21f+6:15047:x1875537125566848:12345-192.168.204.45@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788652080.554808:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f6da5325-c43d-45b2-9745-228d7048f21f+6:15047:x1875537125566848:12345-192.168.204.45@tcp:900:mount.lustre.0 Request processed in 835us (5130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.554819:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:2.0:1788652080.564178:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652080.564286:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125566976 00000100:00100000:3.0:1788652080.564296:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125566976 00000100:00100000:3.0:1788652080.564357:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:3.0:1788652080.564368:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6da5325-c43d-45b2-9745-228d7048f21f+6:15047:x1875537125566976:12345-192.168.204.45@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788652080.564458:0:17190:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788652080.564558:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6da5325-c43d-45b2-9745-228d7048f21f+6:15047:x1875537125566976:12345-192.168.204.45@tcp:33:mount.lustre.0 Request processed in 191us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652080.564565:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 1 00010000:00010000:2.0:1788652080.672410:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652080.806106:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652080.806223:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125567104 00000100:00100000:1.0:1788652080.806237:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125567104 00000100:00100000:1.0:1788652080.806323:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:1.0:1788652080.806344:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6da5325-c43d-45b2-9745-228d7048f21f+6:15084:x1875537125567104:12345-192.168.204.45@tcp:101:mkdir.0 00010000:00010000:1.0:1788652080.806369:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652080.806395:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c5297 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe340cc expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.806483:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.806498:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.806510:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652080.806569:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788652080.806574:0:17187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788652080.806594:0:17187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.806622:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c5297 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340cc expref: 8 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.806657:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340cc expref: 7 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652080.806667:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374e00) 00010000:00010000:1.0:1788652080.806670:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652080.806674:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff414200, rc 0) 00000100:00100000:1.0:1788652080.806741:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6da5325-c43d-45b2-9745-228d7048f21f+7:15084:x1875537125567104:12345-192.168.204.45@tcp:101:mkdir.0 Request processed in 409us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652080.806750:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 22 00010000:00010000:3.0:1788652081.696033:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652082.720635:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652083.168842:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652083.168866:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147671040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788652083.168956:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652083.169031:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147671040 00000100:00100000:2.0:1788652083.169040:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147671040 00000100:00100000:2.0:1788652083.169118:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788652083.169132:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147671040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788652083.169169:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788652083.169220:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147671040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652083.169228:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788652083.169250:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788652083.169423:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788652083.169433:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147671168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788652083.169489:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652083.169715:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652083.169725:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147671296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788652083.169758:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652083.169786:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147671168 00000100:00100000:1.0:1788652083.169790:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147671168 00000100:00100000:1.0:1788652083.169817:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147671296 00000100:00100000:1.0:1788652083.169821:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147671296 00000100:00100000:1.0:1788652083.169840:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788652083.169847:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147671168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788652083.169864:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788652083.169895:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147671168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652083.169901:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788652083.169939:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788652083.169946:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147671296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788652083.169954:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788652083.169995:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147671296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 50us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652083.170002:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788652083.170016:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788652083.170041:0:3635:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1788652083.170066:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86d109b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147671296:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788652083.170110:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147671168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652083.170400:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147671040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788652083.170971:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147671808:0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.171021:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652083.171048:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147672320:0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.171073:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652083.171090:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788652083.171094:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147671680:0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.171114:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652083.171128:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147672192:0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.171145:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652083.171173:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147671808 00000100:00100000:0.0:1788652083.171179:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147671808 00000100:00100000:0.0:1788652083.171213:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788652083.171220:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147671808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.171268:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147671808:12345-0@lo:400:kworker.0 Request processed in 47us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652083.171275:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788652083.171378:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147672320 00000100:00100000:0.0:1788652083.171383:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147672320 00000100:00100000:0.0:1788652083.171419:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147671680 00000100:00100000:0.0:1788652083.171422:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147671680 00000100:00100000:0.0:1788652083.171439:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147672192 00000100:00100000:0.0:1788652083.171441:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147672192 00000100:00100000:0.0:1788652083.171585:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788652083.171596:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147672320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.171628:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147672320:12345-0@lo:400:kworker.0 Request processed in 35us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652083.171633:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788652083.171647:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788652083.171660:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147671680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.171690:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147671680:12345-0@lo:400:kworker.0 Request processed in 31us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652083.171695:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788652083.171708:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788652083.171713:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147672192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.171737:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3636:x1875537147672192:12345-0@lo:400:kworker.0 Request processed in 24us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652083.171743:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1788652083.171764:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788652083.171767:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788652083.171866:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff518a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147671680:0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.171878:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3636:1875537147672192:0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.171888:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147671808:0@lo:400:kworker.0 00010000:00080000:0.0:1788652083.171901:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36f4380 x1875537147672320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652083.171942:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147672320:0@lo:400:kworker.0 00000100:00100000:1.0:1788652083.172214:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147671552:0@lo:400:kworker.0 00000100:00100000:1.0:1788652083.172251:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652083.172292:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147672064:0@lo:400:kworker.0 00000100:00100000:1.0:1788652083.172327:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652083.172345:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147672576:0@lo:400:kworker.0 00000100:00100000:1.0:1788652083.172364:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652083.172382:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788652083.172388:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147671424:0@lo:400:kworker.0 00000100:00100000:1.0:1788652083.172411:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652083.172430:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147671936:0@lo:400:kworker.0 00000100:00100000:1.0:1788652083.172454:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652083.172654:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147671552 00000100:00100000:3.0:1788652083.172661:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147671552 00000100:00100000:3.0:1788652083.172701:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788652083.172708:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147671552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652083.172750:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147671552:12345-0@lo:400:kworker.0 Request processed in 43us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652083.172770:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788652083.172812:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147672064 00000100:00100000:3.0:1788652083.172815:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147672064 00000100:00100000:3.0:1788652083.172836:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147672576 00000100:00100000:3.0:1788652083.172839:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147672576 00000100:00100000:3.0:1788652083.172864:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788652083.172869:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d109ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147672064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652083.172898:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d109ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147672064:12345-0@lo:400:kworker.0 Request processed in 29us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652083.172903:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788652083.172937:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788652083.172943:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147672576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652083.172966:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86d1098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147672576:12345-0@lo:400:kworker.0 Request processed in 23us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652083.172970:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788652083.172987:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788652083.173077:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147672448:0@lo:400:kworker.0 00000100:00100000:1.0:1788652083.173103:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652083.173129:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147671552:0@lo:400:kworker.0 00000100:00100000:1.0:1788652083.173141:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff518e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147672064:0@lo:400:kworker.0 00010000:00080000:1.0:1788652083.173151:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c36f5c00 x1875537147672576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652083.173175:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147672576:0@lo:400:kworker.0 00000100:00100000:3.0:1788652083.173389:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147671936 00000100:00100000:3.0:1788652083.173394:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147671936 00000100:00100000:3.0:1788652083.173440:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788652083.173447:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147671936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652083.173617:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147671936:12345-0@lo:400:kworker.0 Request processed in 170us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652083.173624:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788652083.173645:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147672448 00000100:00100000:3.0:1788652083.173648:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147672448 00000100:00100000:3.0:1788652083.173673:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788652083.173679:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147672448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652083.173715:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3638:x1875537147672448:12345-0@lo:400:kworker.0 Request processed in 36us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652083.173721:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788652083.173753:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff51ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147671936:0@lo:400:kworker.0 00000100:00100000:3.0:1788652083.173763:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3638:1875537147672448:0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.173877:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147671424 00000100:00100000:0.0:1788652083.173882:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147671424 00000100:00100000:0.0:1788652083.173936:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788652083.173943:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3638:x1875537147671424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652083.173980:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3638:x1875537147671424:12345-0@lo:400:kworker.0 Request processed in 38us (1567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652083.173986:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000001:00100000:3.0:1788652083.174266:0:17167:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f6da5325-c43d-45b2-9745-228d7048f21f 00000001:00100000:3.0:1788652083.174275:0:17167:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 13cd7710-0d0a-4bf8-8621-85bf9f039118 00000100:00100000:3.0:1788652083.174367:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff518700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147671424:0@lo:400:kworker.0 00000100:00080000:1.0:1788652083.174584:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788652083.174589:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788652083.177532:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f6da5325-c43d-45b2-9745-228d7048f21f 00000001:00100000:1.0:1788652083.177544:0:18688:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 13cd7710-0d0a-4bf8-8621-85bf9f039118 00000001:00100000:3.0:1788652083.187323:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of f6da5325-c43d-45b2-9745-228d7048f21f 00000001:00100000:3.0:1788652083.187341:0:17918:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 13cd7710-0d0a-4bf8-8621-85bf9f039118 00010000:00010000:1.0:1788652083.745487:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788652084.142769:0:20067:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788652084.192435:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788652084.192469:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147672704:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788652084.192543:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652084.193649:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147672704 00000100:00100000:2.0:1788652084.193659:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147672704 00000100:00100000:2.0:1788652084.193713:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788652084.193723:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147672704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788652084.193746:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788652084.193826:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147672704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 104us (1283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652084.193834:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788652084.195243:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147672704:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788652084.768369:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788652085.092628:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788652085.216574:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788652085.216597:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147672832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788652085.216677:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652085.216714:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652085.216723:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147672960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652085.216747:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652085.216787:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147672832 00000100:00100000:3.0:1788652085.216793:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147672832 00000100:00100000:3.0:1788652085.216837:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147672960 00000100:00100000:3.0:1788652085.216840:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147672960 00000100:00100000:3.0:1788652085.216855:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788652085.216864:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147672832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788652085.216896:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788652085.216965:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147672832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652085.216982:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788652085.217000:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788652085.217007:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147672960:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788652085.217023:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788652085.217057:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147672960:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652085.217063:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788652085.217108:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147672960:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652085.217137:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3458700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147672832:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788652085.794056:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652085.930399:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652085.930453:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652085.930479:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652085.930499:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652085.930518:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652085.930538:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652085.930561:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652085.930580:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652085.930603:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652085.930631:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125567488 00000100:00100000:1.0:1788652085.930641:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125567488 00000100:00100000:1.0:1788652085.930702:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125568000 00000100:00100000:1.0:1788652085.930706:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125568000 00000100:00100000:1.0:1788652085.930720:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125567360 00000100:00100000:1.0:1788652085.930723:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125567360 00000100:00100000:1.0:1788652085.930734:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125567872 00000100:00100000:1.0:1788652085.930737:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125567872 00000100:00100000:1.0:1788652085.930754:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:1.0:1788652085.930763:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2390:x1875537125567488:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652085.930856:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3459180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2390:x1875537125567488:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 92us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652085.930865:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:1.0:1788652085.930881:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 48 00000100:00100000:1.0:1788652085.930887:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+5:2390:x1875537125568000:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652085.930942:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+5:2390:x1875537125568000:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 55us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652085.930948:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 48 00000100:00100000:1.0:1788652085.930958:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 49 00000100:00100000:1.0:1788652085.930964:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2390:x1875537125567360:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652085.930986:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2390:x1875537125567360:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 22us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652085.930991:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 49 00000100:00100000:1.0:1788652085.931001:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 50 00000100:00100000:1.0:1788652085.931007:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+6:2390:x1875537125567872:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652085.931027:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+6:2390:x1875537125567872:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 21us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652085.931033:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 50 00000100:00100000:1.0:1788652085.931055:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125567744 00000100:00100000:1.0:1788652085.931058:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125567744 00000100:00100000:1.0:1788652085.931078:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125568256 00000100:00100000:1.0:1788652085.931081:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125568256 00000100:00100000:1.0:1788652085.931092:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125567616 00000100:00100000:1.0:1788652085.931094:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125567616 00000100:00100000:1.0:1788652085.931106:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125568128 00000100:00100000:1.0:1788652085.931114:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125568128 00000100:00100000:1.0:1788652085.931132:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:1.0:1788652085.931138:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c345b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2390:x1875537125567744:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652085.931161:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c345b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2390:x1875537125567744:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 24us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652085.931166:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:1.0:1788652085.931175:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:1.0:1788652085.931180:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6da5325-c43d-45b2-9745-228d7048f21f+6:2390:x1875537125568256:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652085.931197:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6da5325-c43d-45b2-9745-228d7048f21f+6:2390:x1875537125568256:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 18us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652085.931202:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:1.0:1788652085.931212:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:1.0:1788652085.931217:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2390:x1875537125567616:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652085.931236:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2390:x1875537125567616:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 20us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652085.931242:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:1.0:1788652085.931251:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:1.0:1788652085.931257:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6da5325-c43d-45b2-9745-228d7048f21f+5:2390:x1875537125568128:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652085.931277:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f6da5325-c43d-45b2-9745-228d7048f21f+5:2390:x1875537125568128:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 20us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652085.931283:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00080000:1.0:1788652085.931312:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788652085.931317:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788652085.931320:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788652085.931328:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788652085.934817:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125567232 00000100:00100000:3.0:1788652085.934833:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125567232 00000100:00100000:3.0:1788652085.934944:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 147 00000100:00100000:3.0:1788652085.934955:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2390:x1875537125567232:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788652085.935032:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2390:x1875537125567232:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 79us (4645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652085.935041:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 147 00000001:00100000:2.0:1788652086.247167:0:19510:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f6da5325-c43d-45b2-9745-228d7048f21f 00010000:00010000:1.0:1788652086.817941:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652087.840033:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788652088.068661:0:20215:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1d37baa0 20000000:00000080:2.0:1788652088.068677:0:20215:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8f86f3cd3400 uarg=0000000000000000 20000000:01000000:2.0:1788652088.068730:0:20215:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788652088.068735:0:20215:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788652088.068739:0:20215:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788652088.069569:0:20216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788652088.069730:0:20215:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788652088.080988:0:20215:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788652088.081023:0:20215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.081046:0:20215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86f0906c00/0xcd2f56ea038c4f3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f33 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.081054:0:20215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4f48 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f41 expref: 23 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.081061:0:20215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4f87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c4f80 expref: 23 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.081067:0:20215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f9000/0xcd2f56ea038c50ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c50e5 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.081078:0:20215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c5235 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3402b expref: 12 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.081085:0:20215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8f86f0907800/0xcd2f56ea038c5274 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3409b expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.081093:0:20215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.081155:0:20215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86f0907800/0xcd2f56ea038c5274 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3409b expref: 12 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.081171:0:20215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86f0907800/0xcd2f56ea038c5274 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3409b expref: 12 pid: 17181 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652088.081184:0:20215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673088:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788652088.084088:0:20215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c5235 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3402b expref: 12 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.084107:0:20215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c5235 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3402b expref: 12 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652088.084124:0:20215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673216:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788652088.085690:0:20215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f9000/0xcd2f56ea038c50ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c50e5 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.085713:0:20215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f87021f9000/0xcd2f56ea038c50ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c50e5 expref: 23 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652088.085727:0:20215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673344:0@lo:104: 00000100:00100000:0.0:1788652088.085788:0:20215:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652088.085853:0:20215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4f87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4f80 expref: 23 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.085861:0:20215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4f87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f80 expref: 23 pid: 17181 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652088.085894:0:20215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673472:0@lo:104: 00000100:00100000:0.0:1788652088.085938:0:20215:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652088.085967:0:20215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4f41 expref: 23 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.085976:0:20215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4f48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f41 expref: 23 pid: 17182 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652088.085985:0:20215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673600:0@lo:104: 00000100:00100000:0.0:1788652088.086003:0:20215:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788652088.086017:0:20215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8f86f0906c00/0xcd2f56ea038c4f3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xcd2f56ea038c4f33 expref: 23 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.086025:0:20215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8f86f0906c00/0xcd2f56ea038c4f3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f33 expref: 23 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652088.086032:0:20215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673728:0@lo:104: 00000100:00100000:0.0:1788652088.086047:0:20215:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652088.086054:0:20215:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d85ff6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652088.086231:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147673344 00000100:00100000:2.0:1788652088.086239:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147673344 00000100:00100000:2.0:1788652088.086291:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147673472 00000100:00100000:2.0:1788652088.086295:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147673472 00000100:00100000:2.0:1788652088.086306:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147673600 00000100:00100000:2.0:1788652088.086308:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147673600 00000100:00100000:2.0:1788652088.086316:0:17170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147673728 00000100:00100000:2.0:1788652088.086318:0:17170:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147673728 00000100:00100000:2.0:1788652088.086329:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788652088.086339:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+6:20215:x1875537147673344:12345-0@lo:104: 00010000:00010000:2.0:1788652088.086353:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.086423:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788652088.086429:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+6:20215:x1875537147673344:12345-0@lo:104: Request processed in 92us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.086436:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788652088.086455:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652088.086460:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+5:20215:x1875537147673472:12345-0@lo:104: 00010000:00010000:2.0:1788652088.086468:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.086498:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788652088.086503:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+5:20215:x1875537147673472:12345-0@lo:104: Request processed in 44us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.086509:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788652088.086520:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652088.086525:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+4:20215:x1875537147673600:12345-0@lo:104: 00010000:00010000:2.0:1788652088.086532:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.086556:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788652088.086561:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+4:20215:x1875537147673600:12345-0@lo:104: Request processed in 37us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.086566:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652088.086575:0:17170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652088.086580:0:17170:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:20215:x1875537147673728:12345-0@lo:104: 00010000:00010000:2.0:1788652088.086586:0:17170:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.086614:0:17170:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788652088.086618:0:17170:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a28e2822-101e-46fe-b9c1-7a60e90536a9+3:20215:x1875537147673728:12345-0@lo:104: Request processed in 39us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.086623:0:17170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788652088.087008:0:20215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673344:0@lo:104: 00000100:00100000:0.0:1788652088.087017:0:20215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673472:0@lo:104: 00000100:00100000:0.0:1788652088.087024:0:20215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673600:0@lo:104: 00000100:00100000:0.0:1788652088.087029:0:20215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673728:0@lo:104: 00000100:00100000:1.0:1788652088.087319:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00010000:00010000:1.0:1788652088.087340:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788652088.087348:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087356:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86f4b97a00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652088.087360:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087369:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652088.087375:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652088.087390:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652088.087421:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087428:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788652088.087446:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087453:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f86f4b97a00/0xcd2f56ea038c50e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c50ec expref: -99 pid: 19509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087465:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788652088.087468:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087487:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9c00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652088.087490:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087497:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652088.087502:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652088.087508:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652088.087522:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087528:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652088.087530:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788652088.087537:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087544:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652088.087548:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f9e00 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:3.0:1788652088.087554:0:17176:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087556:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9c00/0xcd2f56ea038c4f80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f87 expref: -99 pid: 18687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087574:0:17175:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788652088.087579:0:17175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652088.087592:0:17176:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087592:0:17175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f87021f8800 already unused, calling callback (ffffffffc149cc20) 10000000:00010000:1.0:1788652088.087597:0:17175:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788652088.087607:0:17176:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652088.087615:0:17176:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788652088.087628:0:17175:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788652088.087636:0:17175:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652088.087637:0:17176:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652088.087648:0:17175:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788652088.087650:0:17176:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652088.087660:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087667:0:17175:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652088.087669:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f9e00/0xcd2f56ea038c4f41 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f48 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087687:0:17175:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788652088.087692:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652088.087695:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788652088.087697:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652088.087704:0:17175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.087712:0:17175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.145@tcp lock: ffff8f87021f8800/0xcd2f56ea038c4f33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xcd2f56ea038c4f3a expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652088.087721:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147673856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652088.087728:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652088.087731:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652088.087733:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788652088.087741:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652088.087756:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125568384 00000100:00100000:1.0:1788652088.087761:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125568384 00000100:00100000:3.0:1788652088.087766:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788652088.087789:0:18719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86f0907800/0xcd2f56ea038c5274 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3409b expref: 13 pid: 17181 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652088.087892:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652088.087900:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147674240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788652088.088072:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147673856 00000100:00100000:1.0:1788652088.088076:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147673856 00010000:00010000:1.0:1788652088.088093:0:18719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f9000/0xcd2f56ea038c50ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c50e5 expref: 24 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652088.088095:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652088.088124:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147674240 00000100:00100000:1.0:1788652088.088128:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147674240 00000100:00100000:3.0:1788652088.088131:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147673984:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652088.088145:0:18719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86f0906c00/0xcd2f56ea038c4f3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f33 expref: 25 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652088.088160:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652088.088165:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:1.0:1788652088.088178:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2389:x1875537125568384:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652088.088328:0:18719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652088.088336:0:18719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86f0907800/0xcd2f56ea038c5274 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3409b expref: 13 pid: 17181 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.088348:0:18719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86f0907800/0xcd2f56ea038c5274 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3409b expref: 13 pid: 17181 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652088.088351:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788652088.088368:0:18719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652088.088422:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2389:x1875537125568384:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 247us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652088.088430:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:1.0:1788652088.088444:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147673984 00000100:00100000:1.0:1788652088.088447:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147673984 00000100:00100000:3.0:1788652088.088452:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147674112:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652088.088460:0:18719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4f87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f80 expref: 26 pid: 17181 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652088.088476:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788652088.088484:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a28e2822-101e-46fe-b9c1-7a60e90536a9+26:3638:x1875537147673856:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652088.088489:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788652088.088497:0:18719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652088.088504:0:18719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f9000/0xcd2f56ea038c50ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c50e5 expref: 26 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652088.088517:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147674112 00010000:00010000:1.0:1788652088.088521:0:18719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f9000/0xcd2f56ea038c50ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c50e5 expref: 26 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652088.088523:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147674112 00010000:00010000:1.0:1788652088.088537:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f9000/0xcd2f56ea038c50ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c50e5 expref: 27 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652088.088546:0:17174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4f48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f41 expref: 27 pid: 17182 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.088549:0:18719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652088.088567:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788652088.088575:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a28e2822-101e-46fe-b9c1-7a60e90536a9+26:3638:x1875537147674240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652088.088584:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788652088.088585:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a28e2822-101e-46fe-b9c1-7a60e90536a9+26:3638:x1875537147673856:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (820us total) trans 0 rc 0/0 00010000:00010000:3.0:1788652088.088592:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86f0906c00/0xcd2f56ea038c4f3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f33 expref: 26 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652088.088598:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788652088.088609:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86f0906c00/0xcd2f56ea038c4f3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f33 expref: 25 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652088.088617:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788652088.088624:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f0906c00/0xcd2f56ea038c4f3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4f33 expref: 25 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652088.088626:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a28e2822-101e-46fe-b9c1-7a60e90536a9+25:3635:x1875537147673984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788652088.088640:0:18719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652088.088642:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788652088.088648:0:18719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4f87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f80 expref: 24 pid: 17181 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.088658:0:18719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4f87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f80 expref: 24 pid: 17181 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652088.088671:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f9600/0xcd2f56ea038c4f87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4f80 expref: 24 pid: 17181 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652088.088674:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3638:x1875537147674240:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652088.088689:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788652088.088691:0:18719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652088.088705:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788652088.088714:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:3635:x1875537147674112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788652088.088723:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788652088.088725:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:3635:x1875537147673984:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (565us total) trans 0 rc 0/0 00010000:00010000:3.0:1788652088.088730:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4f48 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f41 expref: 22 pid: 17182 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652088.088737:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788652088.088758:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4f48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xcd2f56ea038c4f41 expref: 21 pid: 17182 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652088.088771:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f4b97600/0xcd2f56ea038c4f48 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xcd2f56ea038c4f41 expref: 21 pid: 17182 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.089177:0:20215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86f0907800/0xcd2f56ea038c5274 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3409b expref: 12 pid: 17181 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652088.089189:0:20215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673088:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788652088.089618:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652088.089656:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:3635:x1875537147674112:12345-0@lo:103:ldlm_bl.0 Request processed in 943us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652088.089664:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788652088.090054:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147674240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788652088.090068:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147673856:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652088.090079:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147674112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788652088.090092:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a28e2822-101e-46fe-b9c1-7a60e90536a9:3635:1875537147673984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788652088.092243:0:20215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20215:1875537147673216:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788652088.092354:0:20215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652088.093097:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652088.093171:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125568512 00000100:00100000:2.0:1788652088.093180:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125568512 00010000:00010000:2.0:1788652088.093227:0:18719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c5235 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3402b expref: 12 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652088.093264:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:2.0:1788652088.093283:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:2388:x1875537125568512:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652088.093299:0:18719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652088.093304:0:18719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c5235 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3402b expref: 12 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093316:0:18719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c5235 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3402b expref: 12 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093333:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f87021f8600/0xcd2f56ea038c5235 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3402b expref: 12 pid: 17179 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093349:0:18719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093358:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093399:0:18719:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093407:0:18719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093413:0:18719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093419:0:18719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093425:0:18719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4800 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652088.093429:0:18719:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093437:0:18719:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093455:0:18719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652088.093465:0:18719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652088.093521:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:2388:x1875537125568512:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 248us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.093529:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 14 00010000:00010000:0.0:1788652088.093643:0:20215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.093651:0:20215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652088.093658:0:20215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8f86e7da4800/0xcd2f56ea038c52a5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652088.288083:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788652088.288115:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147674368:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788652088.288183:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652088.288312:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147674496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652088.288351:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652088.288395:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147674368 00000100:00100000:3.0:1788652088.288403:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147674368 00000100:00100000:3.0:1788652088.288446:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147674496 00000100:00100000:3.0:1788652088.288449:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147674496 00000100:00100000:3.0:1788652088.288464:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788652088.288472:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147674368:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788652088.288500:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788652088.288543:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3637:x1875537147674368:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652088.288550:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788652088.288565:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788652088.288571:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147674496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788652088.288588:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788652088.288616:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147674496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 45us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652088.288622:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788652088.288636:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652088.288672:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147674496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652088.288702:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3637:1875537147674368:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788652088.290175:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147674624:0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.290233:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652088.290260:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147675136:0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.290278:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652088.290295:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147675648:0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.290315:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652088.290346:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788652088.290352:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147675008:0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.290372:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652088.291074:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147674880:0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.291110:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652088.291133:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147675392:0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.291165:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652088.291187:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788652088.291193:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147674752:0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.291214:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652088.291231:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147675264:0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.291250:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652088.291267:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147675776:0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.291286:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652088.291639:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147675904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788652088.291673:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652088.293234:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147675648 00000100:00100000:2.0:1788652088.293248:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147675648 00000100:00100000:2.0:1788652088.293303:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147674880 00000100:00100000:2.0:1788652088.293306:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147674880 00000100:00100000:2.0:1788652088.293321:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147675392 00000100:00100000:2.0:1788652088.293324:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147675392 00000100:00100000:2.0:1788652088.293336:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147675264 00000100:00100000:2.0:1788652088.293339:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147675264 00000100:00100000:2.0:1788652088.293350:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147675776 00000100:00100000:2.0:1788652088.293353:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147675776 00000100:00100000:2.0:1788652088.293375:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788652088.293396:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147675648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.293473:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3636:x1875537147675648:12345-0@lo:400:kworker.0 Request processed in 79us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.293480:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788652088.293498:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788652088.293503:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147674880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.296206:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147675520:0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.296266:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652088.296299:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3636:1875537147675648:0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.296834:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147674624 00000100:00100000:3.0:1788652088.296843:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147674624 00000100:00100000:2.0:1788652088.297093:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3638:x1875537147674880:12345-0@lo:400:kworker.0 Request processed in 3587us (5979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.297104:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788652088.297141:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147675520 00000100:00100000:2.0:1788652088.297145:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147675520 00000100:00100000:2.0:1788652088.297175:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788652088.297196:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147675392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.297253:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3638:x1875537147675392:12345-0@lo:400:kworker.0 Request processed in 59us (6086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.297259:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788652088.297272:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788652088.297279:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147675264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.297308:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3638:x1875537147675264:12345-0@lo:400:kworker.0 Request processed in 30us (6056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.297313:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788652088.297324:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788652088.297331:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147675776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.297360:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3638:x1875537147675776:12345-0@lo:400:kworker.0 Request processed in 29us (6072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.297365:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788652088.297386:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788652088.297393:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147675520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.297428:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3636:x1875537147675520:12345-0@lo:400:kworker.0 Request processed in 36us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.297434:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788652088.297460:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147675136 00000100:00100000:2.0:1788652088.297464:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147675136 00000100:00100000:2.0:1788652088.297491:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147674752 00000100:00100000:2.0:1788652088.297495:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147674752 00000100:00100000:2.0:1788652088.297511:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652088.297523:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147675136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.297554:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147675136:12345-0@lo:400:kworker.0 Request processed in 32us (7275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.297560:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788652088.297571:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788652088.297577:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147674752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652088.297602:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147674752:12345-0@lo:400:kworker.0 Request processed in 26us (6387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652088.297607:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788652088.297822:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788652088.297827:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788652088.297830:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788652088.302699:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147675008 00000100:00100000:3.0:1788652088.302718:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147675008 00000100:00100000:3.0:1788652088.302766:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788652088.302777:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147674624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.303481:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147674624:12345-0@lo:400:kworker.0 Request processed in 705us (13245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652088.303491:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788652088.303518:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788652088.303526:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147675008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.303558:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147675008:12345-0@lo:400:kworker.0 Request processed in 34us (13184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652088.303563:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788652088.303728:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3638:1875537147674880:0@lo:400:kworker.0 00000100:00100000:1.0:1788652088.303744:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3638:1875537147675392:0@lo:400:kworker.0 00000100:00100000:1.0:1788652088.303773:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147674752:0@lo:400:kworker.0 00000100:00100000:1.0:1788652088.303785:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3638:1875537147675264:0@lo:400:kworker.0 00010000:00080000:1.0:1788652088.303801:0:3638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86c4e0e300 x1875537147675776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652088.303874:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3638:1875537147675776:0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.308167:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147675904 00000100:00100000:3.0:1788652088.308185:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147675904 00000100:00100000:3.0:1788652088.308240:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788652088.308249:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147675904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788652088.308280:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788652088.308942:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147675904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 655us (17228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652088.308959:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788652088.311321:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147675008:0@lo:400:kworker.0 00010000:00080000:3.0:1788652088.311886:0:3636:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f86c4e0ca80 x1875537147675520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788652088.311899:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3636:1875537147675520:0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.311943:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147674624:0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.311956:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147675136:0@lo:400:kworker.0 00000100:00100000:3.0:1788652088.312098:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147675904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788652088.865113:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788652089.189331:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652089.189501:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125568640 00000100:00100000:0.0:1788652089.189511:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125568640 00000100:00100000:0.0:1788652089.189585:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 148 00000100:00100000:0.0:1788652089.189597:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+11:14931:x1875537125568640:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788652089.189616:0:17182:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652089.189639:0:17182:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f86e7da4e00/0xcd2f56ea038c52ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe340d3 expref: -99 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652089.189671:0:17182:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f86e7da4e00/0xcd2f56ea038c52ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340d3 expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652089.189685:0:17182:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f86e7da4e00/0xcd2f56ea038c52ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340d3 expref: 12 pid: 17182 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652089.189696:0:17182:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4e00, rc 0) 00000100:00100000:0.0:1788652089.189980:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:14931:x1875537125568640:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 Request processed in 384us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652089.189995:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 148 00000100:00100000:2.0:1788652089.205049:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652089.205326:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125568768 00000100:00100000:3.0:1788652089.205337:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125568768 00000100:00100000:3.0:1788652089.205409:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 149 00000100:00100000:3.0:1788652089.205418:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:14931:x1875537125568768:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.205572:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6769450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:14931:x1875537125568768:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 Request processed in 154us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652089.205580:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 149 00000100:00100000:2.0:1788652089.208669:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652089.208801:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125568896 00000100:00100000:0.0:1788652089.208813:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125568896 00000100:00100000:0.0:1788652089.208867:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 150 00000100:00100000:0.0:1788652089.208875:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:14931:x1875537125568896:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652089.209054:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6768050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:14931:x1875537125568896:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 Request processed in 179us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652089.209063:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 150 00000100:00100000:1.0:1788652089.235114:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652089.235683:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125569024 00000100:00100000:2.0:1788652089.235697:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125569024 00000100:00100000:2.0:1788652089.235772:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 151 00000100:00100000:2.0:1788652089.235785:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f676bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+12:14931:x1875537125569024:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652089.235806:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652089.235827:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c6e00/0xcd2f56ea038c52b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe340da expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.235858:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c6e00/0xcd2f56ea038c52b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340da expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.235870:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c6e00/0xcd2f56ea038c52b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340da expref: 13 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.235902:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6e00, rc 0) 00000100:00100000:2.0:1788652089.235985:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f676bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:14931:x1875537125569024:12345-192.168.204.45@tcp:101:ll_cfg_requeue.0 Request processed in 203us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652089.235993:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 151 00000100:00100000:2.0:1788652089.242863:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652089.243961:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125569152 00000100:00100000:3.0:1788652089.243976:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125569152 00000100:00100000:3.0:1788652089.244048:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 152 00000100:00100000:3.0:1788652089.244060:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:14931:x1875537125569152:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.244414:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:14931:x1875537125569152:12345-192.168.204.45@tcp:501:ll_cfg_requeue.0 Request processed in 355us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652089.244423:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 152 00000100:00100000:2.0:1788652089.247266:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652089.247338:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125569280 00000100:00100000:0.0:1788652089.247348:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125569280 00000100:00100000:0.0:1788652089.247413:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 153 00000100:00100000:0.0:1788652089.247423:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:14931:x1875537125569280:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652089.247568:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:14931:x1875537125569280:12345-192.168.204.45@tcp:503:ll_cfg_requeue.0 Request processed in 145us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652089.247576:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 153 00000100:00100000:1.0:1788652089.313127:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788652089.313153:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147676032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788652089.313302:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652089.313350:0:18696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147676032 00000100:00100000:1.0:1788652089.313369:0:18696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147676032 00000100:00100000:1.0:1788652089.313424:0:18696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788652089.313433:0:18696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147676032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788652089.313459:0:18696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788652089.313511:0:18696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147676032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652089.313518:0:18696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788652089.313582:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147676032:0@lo:13:osp-pre-0-1.0 00000040:00080000:2.0:1788652089.569298:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788652089.824018:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788652089.824027:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86f3cfe800 from 13 10000000:01000000:0.0:1788652089.824032:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788652089.824077:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652089.824089:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652089.824113:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652089.824152:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c36f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788652089.824216:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652089.824264:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0e880c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652089.829526:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147676160 00000100:00100000:2.0:1788652089.829540:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147676160 00000100:00100000:2.0:1788652089.829594:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788652089.829606:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+20:17184:x1875537147676160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652089.829626:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652089.829648:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c7400/0xcd2f56ea038c52c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c52ba expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.829678:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c7400/0xcd2f56ea038c52c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c52ba expref: 21 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.829690:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c7400/0xcd2f56ea038c52c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c52ba expref: 21 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.829700:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7400, rc 0) 00000100:00100000:2.0:1788652089.829787:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:17184:x1875537147676160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 184us (5570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652089.829794:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788652089.830510:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c36f5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652089.830533:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652089.830545:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652089.830720:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.830769:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652089.830806:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fb18cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652089.832161:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147676288 00000100:00100000:0.0:1788652089.832171:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147676288 00000100:00100000:0.0:1788652089.832226:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788652089.832234:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:17184:x1875537147676288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652089.832400:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:17184:x1875537147676288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652089.832408:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788652089.832586:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.832634:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.832753:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652089.832962:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fb18cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788652089.833241:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147676416 00000100:00100000:0.0:1788652089.833247:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147676416 00000100:00100000:0.0:1788652089.835427:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788652089.835452:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:17184:x1875537147676416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652089.835649:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:17184:x1875537147676416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (2894us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652089.835657:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788652089.835764:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788652089.836603:0:20294:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788652089.836664:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788652089.836686:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788652089.836697:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.836708:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86e7da5800/0xcd2f56ea038c52ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52c1 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788652089.836719:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788652089.836722:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86c6e8c000 from 13 10000000:01000000:2.0:1788652089.836725:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788652089.836761:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.836770:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.836780:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652089.836803:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788652089.836852:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652089.839769:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788652089.839805:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147676544 00000100:00100000:2.0:1788652089.839814:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147676544 00000100:00100000:2.0:1788652089.839874:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788652089.839883:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+21:17184:x1875537147676544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652089.839898:0:17179:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652089.839941:0:17179:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c52cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c52c8 expref: -99 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.839969:0:17179:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c52cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c52c8 expref: 22 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.839979:0:17179:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c6a00/0xcd2f56ea038c52cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c52c8 expref: 22 pid: 17179 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.839989:0:17179:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6a00, rc 0) 00000100:00100000:2.0:1788652089.840057:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:17184:x1875537147676544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (3205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652089.840066:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788652089.840122:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652089.840141:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.840151:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652089.840223:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788652089.840253:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652089.840263:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86f3d7e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788652089.840711:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147676672 00000100:00100000:3.0:1788652089.840718:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147676672 00000100:00100000:3.0:1788652089.840750:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788652089.840768:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:17184:x1875537147676672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.841022:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:17184:x1875537147676672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652089.841031:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788652089.841088:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.841126:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.841166:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652089.841188:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86fb18cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788652089.841202:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147676800 00000100:00100000:3.0:1788652089.841205:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147676800 00000100:00100000:3.0:1788652089.841226:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788652089.841231:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:17184:x1875537147676800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.841310:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:17184:x1875537147676800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652089.841316:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788652089.841365:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788652089.842742:0:20295:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788652089.859385:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788652089.859413:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788652089.859429:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652089.859443:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f85c35c7800/0xcd2f56ea038c52c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52cf expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788652089.859456:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788652089.859458:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f85c3548800 from 13 10000000:01000000:1.0:1788652089.859461:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788652089.859504:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652089.859512:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652089.859523:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652089.859548:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788652089.859614:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652089.859665:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2c2c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788652089.859795:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147676928 00000100:00100000:2.0:1788652089.859804:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147676928 00000100:00100000:2.0:1788652089.859862:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788652089.859873:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+22:17184:x1875537147676928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652089.859927:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652089.859941:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c52dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c52d6 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.859968:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c52dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c52d6 expref: 23 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.859979:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c7a00/0xcd2f56ea038c52dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c52d6 expref: 23 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.859989:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7a00, rc 0) 00000100:00100000:2.0:1788652089.860115:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:17184:x1875537147676928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652089.860122:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788652089.860194:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147676928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788652089.860210:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652089.860219:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652089.860295:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147677056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652089.860321:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652089.860363:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2c2c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652089.860419:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147677056 00000100:00100000:0.0:1788652089.860425:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147677056 00000100:00100000:0.0:1788652089.860462:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788652089.860470:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:17184:x1875537147677056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652089.860595:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:17184:x1875537147677056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652089.860603:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788652089.860757:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147677056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788652089.860784:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147677184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788652089.860836:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652089.860861:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2c2c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788652089.860891:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147677184 00000100:00100000:3.0:1788652089.860902:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147677184 00000100:00100000:3.0:1788652089.860999:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788652089.861005:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:17184:x1875537147677184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.861235:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:17184:x1875537147677184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652089.861242:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788652089.861390:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147677184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788652089.874341:0:20296:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788652089.875044:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788652089.875070:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788652089.875081:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652089.875102:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86ff415600/0xcd2f56ea038c52d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52dd expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788652089.875113:0:17184:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788652089.875116:0:17184:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8f86c3255800 from 13 10000000:01000000:3.0:1788652089.875120:0:17184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788652089.875162:0:17184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652089.875171:0:17184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652089.875182:0:17184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652089.875209:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147677312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.875276:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652089.875321:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc480 going to sleep for 11 seconds 00000100:00100000:2.0:1788652089.875382:0:17181:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147677312 00000100:00100000:2.0:1788652089.875390:0:17181:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147677312 00000100:00100000:2.0:1788652089.875496:0:17181:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788652089.875506:0:17181:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+23:17184:x1875537147677312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788652089.875519:0:17181:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652089.875532:0:17181:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8f85c35c7c00/0xcd2f56ea038c52eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xcd2f56ea038c52e4 expref: -99 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.875568:0:17181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8f85c35c7c00/0xcd2f56ea038c52eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xcd2f56ea038c52e4 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.875580:0:17181:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8f85c35c7c00/0xcd2f56ea038c52eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xcd2f56ea038c52e4 expref: 24 pid: 17181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652089.875589:0:17181:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7c00, rc 0) 00000100:00100000:2.0:1788652089.875656:0:17181:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:17184:x1875537147677312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652089.875663:0:17181:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788652089.875747:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147677312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788652089.875771:0:17184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652089.875780:0:17184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652089.875849:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147677440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.876022:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652089.881942:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788652089.883192:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147677440 00000100:00100000:0.0:1788652089.883220:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147677440 00000100:00100000:0.0:1788652089.883270:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788652089.883279:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:17184:x1875537147677440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788652089.883453:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:17184:x1875537147677440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (7429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652089.883461:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788652089.884420:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147677440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.884474:0:17184:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147677568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788652089.884528:0:17184:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652089.884556:0:17184:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86cabbc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788652089.884615:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147677568 00000100:00100000:0.0:1788652089.884620:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147677568 00000100:00100000:0.0:1788652089.884649:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788652089.884655:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:17184:x1875537147677568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788652089.884772:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:17184:x1875537147677568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652089.884779:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788652089.890400:0:17184:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a28e2822-101e-46fe-b9c1-7a60e90536a9:17184:1875537147677568:0@lo:503:ll_cfg_requeue.0 00010000:00010000:1.0:1788652089.891139:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788652089.892132:0:20297:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788652089.896788:0:17184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788652089.897076:0:17184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.145@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788652089.897619:0:17184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652089.897634:0:17184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.145@tcp lock: ffff8f86c1502600/0xcd2f56ea038c52e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xcd2f56ea038c52eb expref: -99 pid: 17184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652090.340072:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147677824:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788652090.340141:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652090.340198:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147677824 00000100:00100000:3.0:1788652090.340205:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147677696:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788652090.340207:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147677824 00000100:00100000:3.0:1788652090.340254:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652090.344575:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147677696 00000100:00100000:1.0:1788652090.344592:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147677696 00000100:00100000:1.0:1788652090.344658:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788652090.344667:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147677824:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652090.344792:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652090.345259:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147677824:12345-0@lo:41:osp-pre-1-0.0 Request processed in 592us (5115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652090.345268:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788652090.345305:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788652090.345313:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147677696:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788652090.345333:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788652090.345843:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147677696:12345-0@lo:41:osp-pre-0-1.0 Request processed in 530us (5588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652090.345860:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788652090.346665:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3d52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147677696:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652090.353065:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86c4e0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147677824:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788652090.912273:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652091.045715:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652091.045765:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652091.045804:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652091.045831:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652091.045848:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652091.045873:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652091.045962:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652091.045983:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125569664 00000100:00100000:0.0:1788652091.045991:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652091.045997:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125569664 00000100:00100000:0.0:1788652091.046018:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652091.046045:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125569920 00000100:00100000:0.0:1788652091.046050:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125569920 00000100:00100000:2.0:1788652091.046074:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125570176 00000100:00100000:2.0:1788652091.046079:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125570176 00000100:00100000:0.0:1788652091.046083:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125570432 00000100:00100000:2.0:1788652091.046101:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125569536 00000100:00100000:0.0:1788652091.046102:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125570432 00000100:00100000:2.0:1788652091.046106:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125569536 00000100:00100000:2.0:1788652091.046139:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125570048 00000100:00100000:0.0:1788652091.046140:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125569792 00000100:00100000:2.0:1788652091.046144:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125570048 00000100:00100000:0.0:1788652091.046146:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125569792 00000100:00100000:2.0:1788652091.046170:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:2.0:1788652091.046182:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2391:x1875537125569664:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652091.046185:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125570304 00000100:00100000:0.0:1788652091.046190:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125570304 00000100:00100000:0.0:1788652091.046212:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:0.0:1788652091.046223:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2391:x1875537125569920:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652091.046271:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2391:x1875537125569664:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 91us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652091.046279:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:2.0:1788652091.046299:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:2.0:1788652091.046306:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+5:2391:x1875537125570176:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:3.0:1788652091.046385:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:1.0:1788652091.046389:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125569408 00000100:00100000:1.0:1788652091.046394:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125569408 00000100:00100000:3.0:1788652091.046399:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+5:2391:x1875537125570432:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652091.046431:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 166 00000100:00100000:1.0:1788652091.046439:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2391:x1875537125569408:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652091.047203:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2391:x1875537125569920:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 979us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652091.047212:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:0.0:1788652091.047233:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:0.0:1788652091.047242:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2391:x1875537125569792:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652091.047273:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2391:x1875537125569792:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 34us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652091.047278:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:0.0:1788652091.047288:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:0.0:1788652091.047294:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6da5325-c43d-45b2-9745-228d7048f21f+5:2391:x1875537125570304:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652091.047638:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f6da5325-c43d-45b2-9745-228d7048f21f+5:2391:x1875537125570304:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 343us (1620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652091.047644:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00080000:0.0:1788652091.047873:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652091.047879:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788652091.047882:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788652091.047885:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788652091.047899:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:0.0:1788652091.047930:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2391:x1875537125569536:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652091.047980:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2391:x1875537125569536:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 73us (2106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652091.047987:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:0.0:1788652091.048003:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:0.0:1788652091.048009:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6da5325-c43d-45b2-9745-228d7048f21f+6:2391:x1875537125570048:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:0.0:1788652091.048026:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f6da5325-c43d-45b2-9745-228d7048f21f+6:2391:x1875537125570048:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 18us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652091.048031:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:2.0:1788652091.048368:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+5:2391:x1875537125570176:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 2060us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652091.048377:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:3.0:1788652091.048921:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+5:2391:x1875537125570432:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 2508us (3052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652091.048944:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:1.0:1788652091.050009:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2391:x1875537125569408:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 3562us (4299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652091.050022:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 166 00000100:00100000:2.0:1788652091.830042:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652091.830125:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125570560 00000100:00100000:0.0:1788652091.830135:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125570560 00000100:00100000:0.0:1788652091.830204:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:0.0:1788652091.830215:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:15600:x1875537125570560:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652091.830239:0:19982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652091.830267:0:19982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c52f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe340e1 expref: -99 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830351:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4200/0xcd2f56ea038c52f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830364:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4200/0xcd2f56ea038c52f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830379:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4200/0xcd2f56ea038c52f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830395:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5300 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830422:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830429:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830635:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5000/0xcd2f56ea038c5307 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830645:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5000/0xcd2f56ea038c5307 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830651:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5000/0xcd2f56ea038c5307 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652091.830681:0:19982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788652091.830685:0:19982:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788652091.830725:0:19982:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5000/0xcd2f56ea038c5307 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830738:0:19982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4200/0xcd2f56ea038c52f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830745:0:19982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4200/0xcd2f56ea038c52f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830752:0:19982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4200/0xcd2f56ea038c52f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830770:0:19982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652091.830775:0:19982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4200/0xcd2f56ea038c52f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830854:0:19982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4200/0xcd2f56ea038c52f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830868:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374e00) 00010000:00010000:0.0:1788652091.830871:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652091.830875:0:19982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4200/0xcd2f56ea038c52f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830883:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4200/0xcd2f56ea038c52f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830898:0:19982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5300 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830904:0:19982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5300 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830978:0:19982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5300 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830983:0:19982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652091.830986:0:19982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5300 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830991:0:19982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5300 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.830999:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8f86ee978c00) 00010000:00010000:0.0:1788652091.831001:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652091.831004:0:19982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5300 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.831021:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5300 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.831060:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c52f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340e1 expref: 8 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.831074:0:19982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5000/0xcd2f56ea038c5307 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340e1 expref: 7 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.831081:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f86ee978700) 00010000:00010000:0.0:1788652091.831084:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788652091.831087:0:19982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5000, rc 0) 00000100:00100000:0.0:1788652091.831158:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:15600:x1875537125570560:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 945us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652091.831166:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:0.0:1788652091.835636:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652091.835721:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125570688 00000100:00100000:1.0:1788652091.835733:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125570688 00000100:00100000:1.0:1788652091.835873:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:1.0:1788652091.835884:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c36f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:15600:x1875537125570688:12345-192.168.204.45@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788652091.836013:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c36f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:15600:x1875537125570688:12345-192.168.204.45@tcp:900:lhsmtool_posix.0 Request processed in 130us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652091.836021:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:3.0:1788652091.839848:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652091.840943:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125570944 00000100:00100000:0.0:1788652091.840960:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125570944 00000100:00100000:0.0:1788652091.841084:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:0.0:1788652091.841097:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:15600:x1875537125570944:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652091.841123:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652091.841144:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c530e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe340e8 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.841228:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5315 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.841260:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5315 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.841272:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5315 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.841356:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c531c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.841364:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c531c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.841372:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c531c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.841489:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4c00/0xcd2f56ea038c5323 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842632:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4c00/0xcd2f56ea038c5323 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842653:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4c00/0xcd2f56ea038c5323 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652091.842668:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788652091.842850:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5315 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842860:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5315 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842866:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5315 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842879:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652091.842883:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5315 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842891:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5315 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842903:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8f86ee978700) 00010000:00010000:0.0:1788652091.842923:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652091.842928:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5315 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842934:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5315 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842950:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c531c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842957:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c531c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842963:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c531c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842967:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652091.842970:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c531c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842976:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c531c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.842993:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8f86ee978c00) 00010000:00010000:0.0:1788652091.842996:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652091.842999:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c531c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.843004:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c531c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.846240:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c530e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340e8 expref: 10 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.846273:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4c00/0xcd2f56ea038c5323 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340e8 expref: 9 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.846283:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86ee978500) 00010000:00010000:0.0:1788652091.846286:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652091.846290:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4c00, rc 0) 00000100:00100000:0.0:1788652091.846407:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3713100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+9:15600:x1875537125570944:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 5311us (6568us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788652091.846416:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:0.0:1788652091.859137:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652091.859212:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125571072 00000100:00100000:2.0:1788652091.859222:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125571072 00000100:00100000:2.0:1788652091.859336:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:2.0:1788652091.859347:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+9:15600:x1875537125571072:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788652091.859457:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3d52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+9:15600:x1875537125571072:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 Request processed in 112us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652091.859480:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 25 00000100:00100000:3.0:1788652091.863011:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652091.863110:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125571200 00000100:00100000:0.0:1788652091.863128:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125571200 00000100:00100000:0.0:1788652091.863195:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:0.0:1788652091.863206:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:15600:x1875537125571200:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788652091.867318:0:19248:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4055us 00000100:00100000:3.0:1788652091.882648:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:15600:x1875537125571200:12345-192.168.204.45@tcp:59:lhsmtool_posix.0 Request processed in 19430us (19633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652091.882664:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:3.0:1788652091.901283:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652091.901522:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125571328 00000100:00100000:0.0:1788652091.901533:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125571328 00000100:00100000:0.0:1788652091.901613:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 27 00000100:00100000:0.0:1788652091.901624:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+9:15606:x1875537125571328:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788652091.901656:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652091.901679:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe340ef expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901746:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5338 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901761:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5338 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901773:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5338 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901787:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c533f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901794:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c533f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901800:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c533f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901836:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5338 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901843:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5338 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901855:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5338 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901871:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652091.901876:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5338 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901883:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5338 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.901895:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374e00) 00010000:00010000:0.0:1788652091.901898:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652091.901902:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5338 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.902081:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5338 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.902092:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c533f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.902106:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c533f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.902209:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c533f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.902215:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652091.902218:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c533f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.902223:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c533f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.902242:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f86ee978c00) 00010000:00010000:0.0:1788652091.902245:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652091.902248:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c533f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.902331:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c533f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.902366:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5331 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340ef expref: 10 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.902377:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374e00) 00010000:00010000:0.0:1788652091.902379:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652091.902383:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340ef expref: 10 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652091.902391:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5a00, rc 0) 00000100:00100000:3.0:1788652091.907414:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3712a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+9:15606:x1875537125571328:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 5776us (6137us total) trans 0 rc 301/301 00000100:00100000:3.0:1788652091.907427:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 27 00000100:00100000:3.0:1788652091.917757:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652091.917962:0:17195:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125571456 00000100:00100000:2.0:1788652091.917973:0:17195:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125571456 00000100:00100000:2.0:1788652091.918024:0:17195:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:2.0:1788652091.918036:0:17195:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:13cd7710-0d0a-4bf8-8621-85bf9f039118+9:15606:x1875537125571456:12345-192.168.204.45@tcp:700:lfs.0 00000100:00100000:2.0:1788652091.918137:0:17195:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:13cd7710-0d0a-4bf8-8621-85bf9f039118+9:15606:x1875537125571456:12345-192.168.204.45@tcp:700:lfs.0 Request processed in 103us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652091.918145:0:17195:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:1.0:1788652091.928216:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652091.928877:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125571712 00000100:00100000:2.0:1788652091.928890:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125571712 00000100:00100000:2.0:1788652091.929001:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:2.0:1788652091.929012:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+9:15606:x1875537125571712:12345-192.168.204.45@tcp:36:lfs.0 00010000:00010000:2.0:1788652091.929074:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652091.929105:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86f0907000/0xcd2f56ea038c525f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3405c expref: 9 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652091.929127:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374e00) 00010000:00010000:2.0:1788652091.929132:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788652091.929203:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652091.929218:0:17186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340cc expref: 5 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652091.929227:0:17186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652091.929729:0:17186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340cc expref: 5 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652091.929746:0:17186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340cc expref: 5 pid: 17187 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652091.930961:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3de1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147677952:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788652091.931064:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db840 going to sleep for 11 seconds 00010000:00010000:3.0:1788652091.936459:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652091.937128:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3de1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147677952:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788652091.937160:0:17186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652091.941697:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652091.941801:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125571840 00000100:00100000:2.0:1788652091.941813:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125571840 00010000:00010000:2.0:1788652091.941857:0:17173:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340cc expref: 6 pid: 17187 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652091.941900:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:2.0:1788652091.941936:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6da5325-c43d-45b2-9745-228d7048f21f+6:2389:x1875537125571840:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652091.941954:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652091.941961:0:17173:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340cc expref: 6 pid: 17187 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652091.941975:0:17173:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340cc expref: 6 pid: 17187 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652091.942024:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414200/0xcd2f56ea038c529e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340cc expref: 6 pid: 17187 timeout: 647 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652091.942041:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374e00) 00010000:00010000:2.0:1788652091.942046:0:17173:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652091.942056:0:17173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652091.942063:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652091.942098:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652091.942442:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f6da5325-c43d-45b2-9745-228d7048f21f+5:2389:x1875537125571840:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 532us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652091.942450:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 15 00010000:00010000:1.0:1788652091.942669:0:17186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.942678:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.942709:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.942718:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.942727:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.951224:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.951754:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.951845:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788652091.951882:0:17186:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b8a3425 reply state 00000000fa804135 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.951894:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.951900:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:1.0:1788652091.951903:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788652091.951933:0:17186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788652091.951961:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788652091.951974:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.951980:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.951987:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.951993:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652091.951997:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.952219:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.952234:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3374e00) 00010000:00010000:1.0:1788652091.952237:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652091.952241:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.952248:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5346 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788652091.952354:0:17186:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000b8a3425 reply state 00000000fa804135 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.952362:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652091.952368:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f85c3373800) 00010000:00010000:1.0:1788652091.952370:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788652091.952379:0:17186:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788652091.952565:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+10:15606:x1875537125571712:12345-192.168.204.45@tcp:36:lfs.0 Request processed in 23550us (24355us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788652091.952574:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:1.0:1788652092.040460:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.040557:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125571968 00000100:00100000:3.0:1788652092.040568:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125571968 00000100:00100000:3.0:1788652092.040642:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:3.0:1788652092.040654:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+10:15614:x1875537125571968:12345-192.168.204.45@tcp:101:lctl.0 00010000:00010000:3.0:1788652092.040678:0:19248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652092.040706:0:19248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c535b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe340f6 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.040771:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503200/0xcd2f56ea038c5362 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.040785:0:19248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503200/0xcd2f56ea038c5362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.040815:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503200/0xcd2f56ea038c5362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652092.040860:0:19248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788652092.040864:0:19248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788652092.040900:0:19248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503200/0xcd2f56ea038c5362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.040968:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c535b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340f6 expref: 12 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.040986:0:19248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503200/0xcd2f56ea038c5362 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340f6 expref: 11 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.040995:0:19248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:3.0:1788652092.040998:0:19248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788652092.041002:0:19248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1503200, rc 0) 00000100:00100000:3.0:1788652092.041113:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+11:15614:x1875537125571968:12345-192.168.204.45@tcp:101:lctl.0 Request processed in 461us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652092.041119:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:3.0:1788652092.078496:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652092.079868:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125572096 00000100:00100000:2.0:1788652092.079889:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125572096 00000100:00100000:2.0:1788652092.080041:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 30 00000100:00100000:2.0:1788652092.080055:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6da5325-c43d-45b2-9745-228d7048f21f+5:15615:x1875537125572096:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788652092.080086:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652092.080127:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5369 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe340fd expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.080221:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c5370 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.080272:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c5370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.080289:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c5370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652092.080362:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788652092.080367:0:17187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788652092.080391:0:17187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c5370 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.080416:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5369 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340fd expref: 7 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.080437:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7000/0xcd2f56ea038c5370 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe340fd expref: 6 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.080445:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:2.0:1788652092.080448:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788652092.080452:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7000, rc 0) 00000100:00100000:2.0:1788652092.080534:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f6da5325-c43d-45b2-9745-228d7048f21f+6:15615:x1875537125572096:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 483us (2052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652092.080541:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 30 00000100:00100000:0.0:1788652092.091493:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652092.091611:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125572224 00000100:00100000:1.0:1788652092.091621:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125572224 00000100:00100000:1.0:1788652092.092581:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:1.0:1788652092.092600:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+6:15615:x1875537125572224:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:1.0:1788652092.092622:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788652092.092645:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c5377 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34104 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.092892:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c537e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093179:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c537e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093194:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c537e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093207:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c5385 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093214:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c5385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093220:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c5385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093392:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c538c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093402:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c538c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093409:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c538c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788652092.093519:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788652092.093524:0:17186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788652092.093548:0:17186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c538c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093560:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c537e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093567:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c537e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093573:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c537e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093580:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652092.093584:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c537e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093592:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c537e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093604:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:1.0:1788652092.093613:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652092.093619:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c537e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093625:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415e00/0xcd2f56ea038c537e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093638:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c5385 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093644:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c5385 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093649:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c5385 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093654:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652092.093657:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c5385 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093662:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c5385 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093669:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f85c3373800) 00010000:00010000:1.0:1788652092.093671:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652092.093674:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c5385 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093679:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c5385 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093875:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c5377 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34104 expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.093903:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c538c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34104 expref: 7 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.094241:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:1.0:1788652092.094325:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788652092.094330:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86ff415a00, rc 0) 00000100:00100000:1.0:1788652092.094458:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+7:15615:x1875537125572224:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 1863us (3493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652092.094467:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:1.0:1788652092.099956:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652092.100069:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125572352 00000100:00100000:2.0:1788652092.100082:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125572352 00000100:00100000:2.0:1788652092.100285:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:2.0:1788652092.100296:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f6da5325-c43d-45b2-9745-228d7048f21f+5:15615:x1875537125572352:12345-192.168.204.45@tcp:900:lfs.0 00000100:00100000:2.0:1788652092.100398:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f6da5325-c43d-45b2-9745-228d7048f21f+5:15615:x1875537125572352:12345-192.168.204.45@tcp:900:lfs.0 Request processed in 104us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652092.100422:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:2.0:1788652092.105067:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.105516:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125572608 00000100:00100000:3.0:1788652092.105528:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125572608 00000100:00100000:3.0:1788652092.105636:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 32 00000100:00100000:3.0:1788652092.105648:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6da5325-c43d-45b2-9745-228d7048f21f+7:15615:x1875537125572608:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788652092.105672:0:19248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652092.105701:0:19248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c5393 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3410b expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652092.105822:0:19248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788652092.105977:0:19248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c5393 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3410b expref: 9 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.105991:0:19248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:3.0:1788652092.105995:0:19248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788652092.106000:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c5393 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3410b expref: 9 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.106014:0:19248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502400, rc 0) 00000100:00100000:3.0:1788652092.106090:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6da5325-c43d-45b2-9745-228d7048f21f+8:15615:x1875537125572608:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 444us (1033us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1788652092.106097:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 32 00000100:00100000:1.0:1788652092.109613:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.109704:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125572864 00000100:00100000:3.0:1788652092.109718:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125572864 00000100:00100000:3.0:1788652092.109780:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:3.0:1788652092.109790:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+8:15615:x1875537125572864:12345-192.168.204.45@tcp:36:lfs.0 00010000:00010000:3.0:1788652092.109845:0:17188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652092.109872:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415a00/0xcd2f56ea038c538c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34104 expref: 8 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.109889:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:3.0:1788652092.109894:0:17188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652092.109949:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.109984:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.109994:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652092.110494:0:17188:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c35b344 reply state 000000008bd72a08 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.110509:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.110516:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:3.0:1788652092.110518:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:3.0:1788652092.110521:0:17188:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788652092.110528:0:17188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788652092.110613:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+9:15615:x1875537125572864:12345-192.168.204.45@tcp:36:lfs.0 Request processed in 823us (1010us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788652092.110620:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 33 00000100:00100000:1.0:1788652092.113785:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.113994:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125573120 00000100:00100000:3.0:1788652092.114005:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125573120 00000100:00100000:3.0:1788652092.114056:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:3.0:1788652092.114065:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6da5325-c43d-45b2-9745-228d7048f21f+9:15615:x1875537125573120:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:3.0:1788652092.114511:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6da5325-c43d-45b2-9745-228d7048f21f+10:15615:x1875537125573120:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 445us (736us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788652092.114518:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:1.0:1788652092.118444:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652092.118557:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125573376 00000100:00100000:2.0:1788652092.118570:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125573376 00000100:00100000:2.0:1788652092.118778:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:2.0:1788652092.118790:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+10:15615:x1875537125573376:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788652092.118815:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652092.118837:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c53a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34112 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.118961:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.118977:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.118991:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119003:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119010:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119026:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652092.119152:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788652092.119234:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119428:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119435:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119442:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652092.119447:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119455:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119467:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:2.0:1788652092.119471:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652092.119475:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119480:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119495:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119500:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119505:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119509:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652092.119518:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119524:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119530:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f85c3373800) 00010000:00010000:2.0:1788652092.119533:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652092.119535:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119540:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119575:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c53a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34112 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119585:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:2.0:1788652092.119587:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652092.119590:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c53a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34112 expref: 12 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.119598:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7e00, rc 0) 00000100:00100000:2.0:1788652092.119677:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f6da5325-c43d-45b2-9745-228d7048f21f+11:15615:x1875537125573376:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 890us (1246us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788652092.119693:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 34 00000100:00100000:1.0:1788652092.123885:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.124230:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125573504 00000100:00100000:3.0:1788652092.124242:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125573504 00000100:00100000:3.0:1788652092.124420:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 35 00000100:00100000:3.0:1788652092.124431:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6da5325-c43d-45b2-9745-228d7048f21f+11:15615:x1875537125573504:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:3.0:1788652092.124463:0:19248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652092.124484:0:19248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c53c4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34119 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.124582:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.124596:0:19248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.124608:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652092.124711:0:19248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788652092.124716:0:19248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788652092.124736:0:19248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.124763:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c53c4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34119 expref: 13 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.124779:0:19248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34119 expref: 12 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.124787:0:19248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:3.0:1788652092.124790:0:19248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788652092.124792:0:19248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502c00, rc 0) 00000100:00100000:3.0:1788652092.124899:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f6da5325-c43d-45b2-9745-228d7048f21f+12:15615:x1875537125573504:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 469us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652092.124936:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 35 00000100:00100000:1.0:1788652092.130128:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.133975:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125573632 00000100:00100000:3.0:1788652092.133996:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125573632 00000100:00100000:3.0:1788652092.134073:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:3.0:1788652092.134084:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6da5325-c43d-45b2-9745-228d7048f21f+12:15615:x1875537125573632:12345-192.168.204.45@tcp:37:lfs.0 00000100:00100000:3.0:1788652092.140613:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f6da5325-c43d-45b2-9745-228d7048f21f+12:15615:x1875537125573632:12345-192.168.204.45@tcp:37:lfs.0 Request processed in 6519us (10482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652092.140628:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:1.0:1788652092.147479:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652092.147773:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125573888 00000100:00100000:0.0:1788652092.147785:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125573888 00000100:00100000:0.0:1788652092.147859:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:0.0:1788652092.147870:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff48e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6da5325-c43d-45b2-9745-228d7048f21f+12:15615:x1875537125573888:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:0.0:1788652092.148142:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff48e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f6da5325-c43d-45b2-9745-228d7048f21f+13:15615:x1875537125573888:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 274us (672us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788652092.148151:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 4 00000100:00100000:1.0:1788652092.209139:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652092.209796:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125574016 00000100:00100000:2.0:1788652092.209810:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125574016 00000100:00100000:2.0:1788652092.209880:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 36 00000100:00100000:2.0:1788652092.209890:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+11:15622:x1875537125574016:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788652092.209977:0:19982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652092.209999:0:19982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c53d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34120 expref: -99 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210065:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53d9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210079:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210091:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210218:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53e0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210228:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210235:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210321:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c53e7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210330:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c53e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210336:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c53e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652092.210370:0:19982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788652092.210381:0:19982:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788652092.210426:0:19982:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c53e7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210438:0:19982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53d9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210444:0:19982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53d9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210450:0:19982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210456:0:19982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652092.210460:0:19982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53d9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210468:0:19982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53d9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210480:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:2.0:1788652092.210483:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652092.210487:0:19982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210492:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c53d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210505:0:19982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53e0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210510:0:19982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53e0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210525:0:19982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210530:0:19982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f85c35c6800 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652092.210533:0:19982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53e0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210539:0:19982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53e0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210547:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f85c3373800) 00010000:00010000:2.0:1788652092.210550:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788652092.210553:0:19982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53e0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210559:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c53e0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210585:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c53d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34120 expref: 13 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210598:0:19982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7200/0xcd2f56ea038c53e7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34120 expref: 12 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.210605:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:2.0:1788652092.210606:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788652092.210610:0:19982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7200, rc 0) 00000100:00100000:2.0:1788652092.210958:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+12:15622:x1875537125574016:12345-192.168.204.45@tcp:101:bash.0 Request processed in 1068us (1825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652092.210975:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 36 00000100:00100000:1.0:1788652092.215689:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652092.215784:0:17197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125574144 00000100:00100000:2.0:1788652092.215797:0:17197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125574144 00000100:00100000:2.0:1788652092.215900:0:17197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:2.0:1788652092.215939:0:17197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:15622:x1875537125574144:12345-192.168.204.45@tcp:900:bash.0 00000100:00100000:2.0:1788652092.216053:0:17197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:15622:x1875537125574144:12345-192.168.204.45@tcp:900:bash.0 Request processed in 143us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652092.216061:0:17197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:3.0:1788652092.218169:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652092.218271:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125574400 00000100:00100000:0.0:1788652092.218281:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125574400 00000100:00100000:0.0:1788652092.218363:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 37 00000100:00100000:0.0:1788652092.218373:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+12:15622:x1875537125574400:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788652092.218392:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652092.218411:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c53ee lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34127 expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.218535:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.218551:0:17186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34119 expref: 12 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.218561:0:17186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.218600:0:17186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34119 expref: 12 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.218613:0:17186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34119 expref: 12 pid: 19248 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652092.218640:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3cbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147678080:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788652092.218723:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0e88180 going to sleep for 11 seconds 00000100:00100000:0.0:1788652092.221533:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3cbc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147678080:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788652092.221561:0:17186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652092.223444:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652092.223953:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125574528 00000100:00100000:1.0:1788652092.223962:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125574528 00010000:00010000:1.0:1788652092.224002:0:18719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34119 expref: 13 pid: 19248 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652092.224045:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 16 00000100:00100000:1.0:1788652092.224054:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6da5325-c43d-45b2-9745-228d7048f21f+13:2388:x1875537125574528:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652092.224087:0:18719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652092.224096:0:18719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34119 expref: 13 pid: 19248 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.224110:0:18719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34119 expref: 13 pid: 19248 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.224132:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c53cb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34119 expref: 13 pid: 19248 timeout: 648 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.224149:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:1.0:1788652092.224156:0:18719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.224165:0:18719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.224173:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.224206:0:18719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652092.224257:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f6da5325-c43d-45b2-9745-228d7048f21f+12:2388:x1875537125574528:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 204us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652092.224265:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 16 00010000:00010000:0.0:1788652092.224474:0:17186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.224488:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.224511:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.224521:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.224529:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225043:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5403 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225053:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5403 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225059:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5403 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652092.225069:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788652092.225098:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225104:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225110:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225115:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5e00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652092.225126:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225134:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225143:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:0.0:1788652092.225146:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652092.225156:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225162:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c53f5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788652092.225173:0:17186:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000091733f43 reply state 000000003a14b2c8 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225182:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225188:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f86ee978c00) 00010000:00010000:0.0:1788652092.225191:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788652092.225193:0:17186:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788652092.225227:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c53ee lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34127 expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225240:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5403 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34127 expref: 14 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.225246:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:0.0:1788652092.225248:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788652092.225256:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4800, rc 0) 00000100:00100000:0.0:1788652092.225316:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+15:15622:x1875537125574400:12345-192.168.204.45@tcp:101:bash.0 Request processed in 6945us (7162us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788652092.225324:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 37 00000100:00100000:3.0:1788652092.240161:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652092.240387:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125574656 00000100:00100000:0.0:1788652092.240398:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125574656 00000100:00100000:0.0:1788652092.240461:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 38 00000100:00100000:0.0:1788652092.240473:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+15:15622:x1875537125574656:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788652092.240498:0:19248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652092.240520:0:19248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5411 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3412e expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.240609:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c5418 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.240624:0:19248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c5418 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.240637:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c5418 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652092.240687:0:19248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788652092.240692:0:19248:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788652092.240712:0:19248:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c5418 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.240723:0:19248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c5418 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.240749:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5411 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3412e expref: 17 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.240789:0:19248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c5418 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3412e expref: 16 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.240799:0:19248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:0.0:1788652092.240802:0:19248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652092.240806:0:19248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5e00, rc 0) 00000100:00100000:0.0:1788652092.241117:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+16:15622:x1875537125574656:12345-192.168.204.45@tcp:101:bash.0 Request processed in 645us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652092.241124:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 38 00000100:00100000:0.0:1788652092.244628:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.244738:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125574912 00000100:00100000:3.0:1788652092.244748:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125574912 00000100:00100000:3.0:1788652092.244833:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 5 00000100:00100000:3.0:1788652092.244844:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+16:15622:x1875537125574912:12345-192.168.204.45@tcp:35:bash.0 00000100:00100000:3.0:1788652092.245639:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3cbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+17:15622:x1875537125574912:12345-192.168.204.45@tcp:35:bash.0 Request processed in 793us (1015us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788652092.245650:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 5 00000040:00080000:1.0:1788652092.258242:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788652092.334443:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652092.334548:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125575168 00000100:00100000:2.0:1788652092.334559:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125575168 00000100:00100000:2.0:1788652092.334630:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 39 00000100:00100000:2.0:1788652092.334640:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+17:15632:x1875537125575168:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788652092.334663:0:19982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652092.334683:0:19982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c541f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34135 expref: -99 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652092.334777:0:19982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788652092.335500:0:19982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c541f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34135 expref: 19 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.335518:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:2.0:1788652092.335521:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652092.335527:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c541f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34135 expref: 19 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.335543:0:19982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7e00, rc 0) 00000100:00100000:2.0:1788652092.335613:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+18:15632:x1875537125575168:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 974us (1179us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788652092.335621:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 39 00000100:00100000:1.0:1788652092.338025:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.338261:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125575424 00000100:00100000:3.0:1788652092.338272:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125575424 00000100:00100000:3.0:1788652092.338345:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:3.0:1788652092.338357:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+18:15632:x1875537125575424:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:3.0:1788652092.338592:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c4e0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+19:15632:x1875537125575424:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 236us (575us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788652092.338601:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 6 00000100:00100000:0.0:1788652092.384333:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652092.384421:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125575680 00000100:00100000:2.0:1788652092.384432:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125575680 00000100:00100000:2.0:1788652092.384497:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 40 00000100:00100000:2.0:1788652092.384507:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+19:15635:x1875537125575680:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788652092.384531:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652092.384553:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c542d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3413c expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.385048:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5434 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.385063:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5434 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.385077:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5434 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652092.385089:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788652092.385200:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c542d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3413c expref: 22 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.385220:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5434 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3413c expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.385229:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:2.0:1788652092.385232:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652092.385250:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6400, rc 0) 00000100:00100000:2.0:1788652092.385328:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+21:15635:x1875537125575680:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 822us (1007us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788652092.385336:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 40 00000100:00100000:2.0:1788652092.389600:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652092.389718:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.389769:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125575808 00000100:00100000:3.0:1788652092.389781:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125575808 00000100:00100000:3.0:1788652092.389855:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:3.0:1788652092.389867:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+21:2389:x1875537125575808:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652092.389951:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652092.389979:0:17174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5434 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3413c expref: 21 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.390001:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652092.390006:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652092.390064:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+20:2389:x1875537125575808:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 198us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652092.390072:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:0.0:1788652092.391562:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125575936 00000100:00100000:0.0:1788652092.391576:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125575936 00000100:00100000:0.0:1788652092.392084:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 41 00000100:00100000:0.0:1788652092.392096:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+20:15635:x1875537125575936:12345-192.168.204.45@tcp:54:lfs.0 00010000:00010000:0.0:1788652092.392173:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5442 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.392190:0:19248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5442 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.392202:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5442 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.392241:0:19248:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5442 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.392248:0:19248:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5442 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.392270:0:19248:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5442 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.392276:0:19248:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652092.392280:0:19248:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5442 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.392287:0:19248:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5442 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.392308:0:19248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:0.0:1788652092.392312:0:19248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652092.392316:0:19248:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5442 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652092.392322:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5442 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652092.392458:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+20:15635:x1875537125575936:12345-192.168.204.45@tcp:54:lfs.0 Request processed in 364us (2737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652092.392467:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 41 00000100:00100000:1.0:1788652092.395547:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.395646:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125576192 00000100:00100000:3.0:1788652092.395656:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125576192 00000100:00100000:3.0:1788652092.395724:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 7 00000100:00100000:3.0:1788652092.395735:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+20:15635:x1875537125576192:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:3.0:1788652092.397792:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+21:15635:x1875537125576192:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 2031us (2227us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788652092.397805:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 7 00000040:00080000:2.0:1788652092.640820:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788652092.730327:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652092.730600:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125576448 00000100:00100000:2.0:1788652092.730611:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125576448 00000100:00100000:2.0:1788652092.730720:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 42 00000100:00100000:2.0:1788652092.730732:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+21:15666:x1875537125576448:12345-192.168.204.45@tcp:101:cat.0 00010000:00010000:2.0:1788652092.730755:0:17188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652092.730779:0:17188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c5449 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34143 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.730953:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5450 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.730969:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5450 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.730980:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5450 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652092.730990:0:17188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788652092.731138:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c5449 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34143 expref: 24 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.731158:0:17188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5450 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34143 expref: 23 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652092.731183:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:2.0:1788652092.731186:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652092.731190:0:17188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6400, rc 0) 00000100:00100000:2.0:1788652092.731256:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+23:15666:x1875537125576448:12345-192.168.204.45@tcp:101:cat.0 Request processed in 526us (938us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788652092.731264:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 42 00000100:00100000:2.0:1788652092.739230:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652092.739415:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.741336:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125576832 00000100:00100000:3.0:1788652092.741351:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125576832 00000100:00100000:3.0:1788652092.741426:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:3.0:1788652092.741437:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+23:2389:x1875537125576832:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652092.741456:0:18719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652092.741500:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5450 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34143 expref: 23 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.741521:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652092.741525:0:18719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652092.741583:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+22:2389:x1875537125576832:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 148us (2167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652092.741590:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 1 00000100:00100000:1.0:1788652092.743795:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125576704 00000100:00100000:1.0:1788652092.744133:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125576704 00000100:00100000:1.0:1788652092.744238:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:1.0:1788652092.744250:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+22:15666:x1875537125576704:12345-192.168.204.45@tcp:35:cat.0 00000100:00100000:1.0:1788652092.744629:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+23:15666:x1875537125576704:12345-192.168.204.45@tcp:35:cat.0 Request processed in 380us (5413us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788652092.744636:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 8 00000100:00100000:2.0:1788652092.840190:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.840340:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125577088 00000100:00100000:3.0:1788652092.840352:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125577088 00000100:00100000:3.0:1788652092.840416:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 43 00000100:00100000:3.0:1788652092.840426:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+23:15672:x1875537125577088:12345-192.168.204.45@tcp:101:dd.0 00010000:00010000:3.0:1788652092.840449:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652092.840475:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c545e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3414a expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.840590:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c5465 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.840620:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c5465 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.840634:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c5465 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652092.840646:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788652092.840786:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c545e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3414a expref: 26 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.840829:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c5465 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3414a expref: 25 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.840838:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652092.840841:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652092.840845:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502400, rc 0) 00000100:00100000:3.0:1788652092.841214:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+25:15672:x1875537125577088:12345-192.168.204.45@tcp:101:dd.0 Request processed in 787us (1030us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788652092.841222:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 43 00000100:00100000:0.0:1788652092.847826:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652092.847938:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125577216 00000100:00100000:1.0:1788652092.847949:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125577216 00000100:00100000:1.0:1788652092.848122:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:1.0:1788652092.848134:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+25:2391:x1875537125577216:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788652092.848151:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788652092.848176:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c5465 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3414a expref: 25 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652092.848193:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:1.0:1788652092.848198:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788652092.848251:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff51ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+24:2391:x1875537125577216:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 120us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652092.848258:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 2 00000100:00100000:2.0:1788652092.848484:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.849053:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125577344 00000100:00100000:3.0:1788652092.849062:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125577344 00000100:00100000:3.0:1788652092.849125:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 44 00000100:00100000:3.0:1788652092.849135:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+24:15672:x1875537125577344:12345-192.168.204.45@tcp:101:dd.0 00010000:00010000:3.0:1788652092.849158:0:19982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652092.849178:0:19982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5473 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34151 expref: -99 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.849213:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c547a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.849225:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c547a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.849236:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c547a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.849371:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5473 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34151 expref: 26 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.849399:0:19982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c547a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34151 expref: 25 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.849407:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652092.849410:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788652092.849414:0:19982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502200, rc 0) 00000100:00100000:3.0:1788652092.849469:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3de2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+25:15672:x1875537125577344:12345-192.168.204.45@tcp:101:dd.0 Request processed in 336us (984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652092.849477:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 44 00000100:00100000:2.0:1788652092.861866:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652092.861952:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125577600 00000100:00100000:3.0:1788652092.861965:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125577600 00000100:00100000:3.0:1788652092.862032:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 45 00000100:00100000:3.0:1788652092.862042:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+25:15672:x1875537125577600:12345-192.168.204.45@tcp:36:dd.0 00010000:00010000:3.0:1788652092.862223:0:17188:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652092.862250:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c5418 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3412e expref: 25 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.862270:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652092.862275:0:17188:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652092.862458:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.862472:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.862493:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788652092.862553:0:17188:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1788652092.863139:0:17188:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000218a8132 reply state 0000000063dbcc20 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.863153:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652092.863160:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652092.863163:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788652092.863166:0:17188:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788652092.863277:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+27:15672:x1875537125577600:12345-192.168.204.45@tcp:36:dd.0 Request processed in 1234us (1420us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1788652092.863285:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 45 00000020:00080000:3.0:1788652092.863300:0:17188:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788652092.961989:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788652093.010089:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652093.010901:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125577856 00000100:00100000:3.0:1788652093.010943:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125577856 00000100:00100000:3.0:1788652093.011141:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00100000:3.0:1788652093.011152:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+27:15672:x1875537125577856:12345-192.168.204.45@tcp:35:dd.0 00000100:00100000:3.0:1788652093.012094:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+28:15672:x1875537125577856:12345-192.168.204.45@tcp:35:dd.0 Request processed in 940us (2014us total) trans 8589934611 rc 0/0 00000100:00100000:3.0:1788652093.012104:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 9 00000100:00080000:0.0:1788652093.021319:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652093.303243:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652093.303356:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125577984 00000100:00100000:3.0:1788652093.303368:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125577984 00000100:00100000:3.0:1788652093.303429:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:3.0:1788652093.303438:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+28:15686:x1875537125577984:12345-192.168.204.45@tcp:101:stat.0 00010000:00010000:3.0:1788652093.303463:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652093.303483:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c5488 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34158 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303564:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c548f lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303579:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c548f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303593:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c548f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303605:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5496 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303612:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5496 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303619:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5496 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303692:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c549d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303701:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c549d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303708:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c549d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652093.303749:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788652093.303754:0:17187:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788652093.303809:0:17187:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c549d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303832:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c549d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303841:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c548f lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303848:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c548f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303855:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c548f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303860:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788652093.303875:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c548f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303883:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c548f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303895:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:3.0:1788652093.303899:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652093.303903:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c548f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303948:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c548f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303962:0:17187:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5496 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303968:0:17187:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5496 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303980:0:17187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5496 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303985:0:17187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788652093.303987:0:17187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5496 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.303994:0:17187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5496 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.304003:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f86ee978c00) 00010000:00010000:3.0:1788652093.304005:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652093.304008:0:17187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5496 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.304014:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5496 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.304043:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c5488 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34158 expref: 30 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.304058:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c549d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34158 expref: 29 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.304065:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652093.304068:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652093.304076:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502400, rc 0) 00000100:00100000:3.0:1788652093.304149:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff519c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+29:15686:x1875537125577984:12345-192.168.204.45@tcp:101:stat.0 Request processed in 711us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652093.304166:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 46 00000100:00100000:2.0:1788652093.389176:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652093.389260:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125578240 00000100:00100000:3.0:1788652093.389270:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125578240 00000100:00100000:3.0:1788652093.389337:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 47 00000100:00100000:3.0:1788652093.389347:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+29:15692:x1875537125578240:12345-192.168.204.45@tcp:36:truncate.0 00010000:00010000:3.0:1788652093.389402:0:19982:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652093.389427:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c549d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34158 expref: 29 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.389446:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652093.389451:0:19982:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652093.389608:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.389621:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.389632:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788652093.389673:0:19982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1788652093.389698:0:19982:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000649e3f75 reply state 000000009e52365c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.389710:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.389716:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652093.389718:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788652093.389733:0:19982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788652093.389861:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+31:15692:x1875537125578240:12345-192.168.204.45@tcp:36:truncate.0 Request processed in 515us (694us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788652093.389877:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 47 00000020:00080000:3.0:1788652093.389882:0:19982:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788652093.408129:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147678208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788652093.408224:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652093.408385:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788652093.408396:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147678336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788652093.408427:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652093.408459:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147678208 00000100:00100000:0.0:1788652093.408474:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147678208 00000100:00100000:0.0:1788652093.408524:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147678336 00000100:00100000:0.0:1788652093.408527:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147678336 00000100:00100000:0.0:1788652093.408544:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788652093.408554:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147678208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788652093.408582:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788652093.408628:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147678208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652093.408635:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788652093.408655:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652093.408661:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147678336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788652093.408676:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788652093.408705:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff518a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3636:x1875537147678336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652093.408711:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788652093.408754:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3636:1875537147678336:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788652093.408775:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788652093.408779:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788652093.408797:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147678208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788652093.409363:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147678464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788652093.409403:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652093.410214:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147678464 00000100:00100000:1.0:1788652093.410223:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147678464 00000100:00100000:1.0:1788652093.410299:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788652093.410308:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147678464:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788652093.410326:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788652093.410376:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147678464:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652093.410396:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788652093.410552:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788652093.410589:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147678464:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788652093.411178:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147678720:0@lo:400:kworker.0 00000100:00100000:2.0:1788652093.411219:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652093.411244:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788652093.411250:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147678592:0@lo:400:kworker.0 00000100:00100000:2.0:1788652093.411288:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652093.411314:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147679104:0@lo:400:kworker.0 00000100:00100000:2.0:1788652093.411336:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652093.411366:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147679104 00000100:00100000:2.0:1788652093.411379:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147679104 00000100:00100000:2.0:1788652093.411423:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788652093.411429:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147679104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788652093.411469:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147679104:12345-0@lo:400:kworker.0 Request processed in 40us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652093.411475:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788652093.411491:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788652093.411500:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147678976:0@lo:400:kworker.0 00000100:00100000:2.0:1788652093.411524:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652093.411541:0:3636:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788652093.411546:0:3636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147678848:0@lo:400:kworker.0 00000100:00100000:2.0:1788652093.411568:0:3636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788652093.411602:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147679104:0@lo:400:kworker.0 00000100:00100000:3.0:1788652093.411737:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147678720 00000100:00100000:3.0:1788652093.411741:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147678720 00000100:00100000:3.0:1788652093.411764:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147678976 00000100:00100000:3.0:1788652093.411767:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147678976 00000100:00100000:3.0:1788652093.411778:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788652093.411784:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147678720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652093.411820:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3638:x1875537147678720:12345-0@lo:400:kworker.0 Request processed in 36us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652093.411826:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788652093.411837:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788652093.411842:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147678976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652093.411892:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3636:x1875537147678976:12345-0@lo:400:kworker.0 Request processed in 49us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652093.411898:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788652093.411947:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147678848 00000100:00100000:3.0:1788652093.411951:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147678848 00000100:00100000:3.0:1788652093.411976:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788652093.411982:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147678848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652093.412011:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3636:x1875537147678848:12345-0@lo:400:kworker.0 Request processed in 30us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652093.412017:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788652093.412304:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3636:1875537147678848:0@lo:400:kworker.0 00000100:00100000:2.0:1788652093.412314:0:3636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3636:1875537147678976:0@lo:400:kworker.0 00000100:00100000:2.0:1788652093.412339:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3638:1875537147678720:0@lo:400:kworker.0 00000100:00100000:1.0:1788652093.412415:0:17179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147678592 00000100:00100000:1.0:1788652093.412420:0:17179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147678592 00000100:00100000:1.0:1788652093.412458:0:17179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788652093.412466:0:17179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86fbe24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3638:x1875537147678592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788652093.412517:0:17179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86fbe24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a28e2822-101e-46fe-b9c1-7a60e90536a9+24:3638:x1875537147678592:12345-0@lo:400:kworker.0 Request processed in 52us (1237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652093.412524:0:17179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788652093.412684:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147679360:0@lo:400:kworker.0 00000100:00100000:0.0:1788652093.412714:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652093.412734:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788652093.412741:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147679488:0@lo:400:kworker.0 00000100:00100000:0.0:1788652093.412761:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788652093.412783:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147679360 00000100:00100000:0.0:1788652093.412787:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147679360 00000100:00100000:0.0:1788652093.413500:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147679488 00000100:00100000:0.0:1788652093.413515:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147679488 00000100:00100000:0.0:1788652093.413544:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788652093.413551:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147679360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652093.413600:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3635:x1875537147679360:12345-0@lo:400:kworker.0 Request processed in 49us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652093.413606:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788652093.413620:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788652093.413625:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147679488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788652093.413651:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3635:x1875537147679488:12345-0@lo:400:kworker.0 Request processed in 26us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652093.413657:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1788652093.413690:0:3635:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c348d880 x1875537147679488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788652093.413701:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3635:1875537147679488:0@lo:400:kworker.0 00000100:00100000:0.0:1788652093.413709:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3635:1875537147679360:0@lo:400:kworker.0 00000100:00080000:2.0:1788652093.413769:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788652093.413773:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652093.413832:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147679616:0@lo:400:kworker.0 00000100:00100000:1.0:1788652093.413876:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652093.413901:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788652093.413924:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147679232:0@lo:400:kworker.0 00000100:00100000:1.0:1788652093.413948:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652093.413971:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147679744:0@lo:400:kworker.0 00000100:00100000:1.0:1788652093.413991:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652093.415709:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff519180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a28e2822-101e-46fe-b9c1-7a60e90536a9:3638:1875537147678592:0@lo:400:kworker.0 00000100:00100000:3.0:1788652093.415774:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147679616 00000100:00100000:3.0:1788652093.415781:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147679616 00000100:00100000:3.0:1788652093.415859:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147679232 00000100:00100000:3.0:1788652093.415863:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147679232 00000100:00100000:3.0:1788652093.415875:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147679744 00000100:00100000:3.0:1788652093.415878:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147679744 00000100:00100000:3.0:1788652093.415897:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788652093.415904:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147679616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652093.416021:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3637:x1875537147679616:12345-0@lo:400:kworker.0 Request processed in 117us (2143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652093.416028:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788652093.416043:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788652093.416048:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147679232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652093.416073:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3637:x1875537147679232:12345-0@lo:400:kworker.0 Request processed in 26us (2125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652093.416078:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788652093.416088:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788652093.416092:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147679744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788652093.416112:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3637:x1875537147679744:12345-0@lo:400:kworker.0 Request processed in 20us (2121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652093.416116:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788652093.416889:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788652093.416895:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788652093.416949:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3637:1875537147679232:0@lo:400:kworker.0 00010000:00080000:1.0:1788652093.416965:0:3637:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8f85c348f480 x1875537147679744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788652109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788652093.416976:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3637:1875537147679744:0@lo:400:kworker.0 00000100:00100000:1.0:1788652093.416989:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3637:1875537147679616:0@lo:400:kworker.0 00000100:00100000:1.0:1788652093.623960:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652093.624061:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125578368 00000100:00100000:3.0:1788652093.624071:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125578368 00000100:00100000:3.0:1788652093.624207:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 48 00000100:00100000:3.0:1788652093.624218:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+31:15706:x1875537125578368:12345-192.168.204.45@tcp:101:stat.0 00010000:00010000:3.0:1788652093.624246:0:19982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652093.624304:0:19982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ab lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3415f expref: -99 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624369:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c54b2 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624384:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c54b2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624397:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c54b2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624410:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c54b9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624418:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c54b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624425:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c54b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624498:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624507:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624514:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652093.624555:0:19982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:3.0:1788652093.624560:0:19982:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788652093.624579:0:19982:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624613:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624623:0:19982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c54b2 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624629:0:19982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c54b2 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624637:0:19982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c54b2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624643:0:19982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788652093.624648:0:19982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c54b2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624657:0:19982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c54b2 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624670:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:3.0:1788652093.624673:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652093.624679:0:19982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c54b2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624684:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c54b2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624701:0:19982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c54b9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624707:0:19982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c54b9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624719:0:19982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c54b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624724:0:19982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788652093.624728:0:19982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c54b9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624734:0:19982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c54b9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624742:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f86ee978c00) 00010000:00010000:3.0:1788652093.624745:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652093.624748:0:19982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c54b9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624754:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c54b9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624783:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ab lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3415f expref: 33 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624796:0:19982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3415f expref: 32 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.624804:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652093.624806:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788652093.624809:0:19982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502c00, rc 0) 00000100:00100000:3.0:1788652093.624891:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+32:15706:x1875537125578368:12345-192.168.204.45@tcp:101:stat.0 Request processed in 674us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652093.624975:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 48 00000100:00100000:1.0:1788652093.753380:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652093.753574:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125578624 00000100:00100000:0.0:1788652093.753701:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125578624 00000100:00100000:0.0:1788652093.753818:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 49 00000100:00100000:0.0:1788652093.753830:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+32:15716:x1875537125578624:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:0.0:1788652093.753851:0:19248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652093.753871:0:19248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c54c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34166 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652093.754009:0:19248:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788652093.754862:0:19248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c54c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34166 expref: 34 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.754889:0:19248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:0.0:1788652093.754892:0:19248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788652093.754898:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c54c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34166 expref: 34 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.754935:0:19248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4a00, rc 0) 00000100:00100000:0.0:1788652093.755160:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+33:15716:x1875537125578624:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 1331us (1789us total) trans 8589934614 rc 301/301 00000100:00100000:0.0:1788652093.755168:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 49 00000100:00100000:1.0:1788652093.757621:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652093.757755:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125578880 00000100:00100000:3.0:1788652093.757766:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125578880 00000100:00100000:3.0:1788652093.757825:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:3.0:1788652093.757836:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff48dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+33:15716:x1875537125578880:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:3.0:1788652093.758306:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff48dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+34:15716:x1875537125578880:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 472us (693us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788652093.758314:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 10 00000100:00100000:1.0:1788652093.839219:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652093.839396:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125579136 00000100:00100000:0.0:1788652093.839407:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125579136 00000100:00100000:0.0:1788652093.839468:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 50 00000100:00100000:0.0:1788652093.839479:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+34:15722:x1875537125579136:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788652093.839503:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652093.839524:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c54d5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3416d expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.839653:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.839669:0:17186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5403 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34127 expref: 35 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.839676:0:17186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3415f expref: 35 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.839704:0:17186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.839738:0:17186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3415f expref: 35 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.839751:0:17186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3415f expref: 35 pid: 19982 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652093.839764:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147679872:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788652093.839858:0:17186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5403 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34127 expref: 35 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.839868:0:17186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5403 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34127 expref: 35 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652093.839877:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147680000:192.168.204.45@tcp:104: 00000100:00100000:0.0:1788652093.839901:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0e880c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788652093.843441:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652093.843526:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125579392 00000100:00100000:3.0:1788652093.843536:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125579392 00010000:00010000:3.0:1788652093.843580:0:18719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5403 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34127 expref: 36 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652093.843637:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:3.0:1788652093.843647:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3384c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+36:2390:x1875537125579392:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652093.843661:0:18719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652093.843668:0:18719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5403 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34127 expref: 36 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.843679:0:18719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5403 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34127 expref: 36 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.843703:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652093.843709:0:18719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.843754:0:18719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.843761:0:18719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652093.843819:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3384c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+36:2390:x1875537125579392:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 174us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652093.843827:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 17 00000100:00100000:0.0:1788652093.844538:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147679872:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788652093.844553:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c5403 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34127 expref: 35 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652093.844569:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147680000:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788652093.844602:0:17186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652093.852197:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652093.852306:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125579264 00000100:00100000:2.0:1788652093.852316:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125579264 00010000:00010000:2.0:1788652093.852357:0:17173:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3415f expref: 35 pid: 19982 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652093.852396:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:2.0:1788652093.852406:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+35:2391:x1875537125579264:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652093.852437:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652093.852444:0:17173:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3415f expref: 35 pid: 19982 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.852457:0:17173:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3415f expref: 35 pid: 19982 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.852483:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502c00/0xcd2f56ea038c54c0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3415f expref: 35 pid: 19982 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.852498:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:2.0:1788652093.852502:0:17173:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.852512:0:17173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.852519:0:17173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.852549:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652093.852609:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+34:2391:x1875537125579264:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 205us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652093.852617:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00010000:00010000:0.0:1788652093.853004:0:17186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.853012:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652093.853031:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:0.0:1788652093.853169:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c54d5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3416d expref: 35 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.853186:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3416d expref: 34 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.853196:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:0.0:1788652093.853199:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788652093.853201:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5400, rc 0) 00000100:00100000:0.0:1788652093.853239:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+34:15722:x1875537125579136:12345-192.168.204.45@tcp:101:bash.0 Request processed in 13762us (14032us total) trans 8589934616 rc 0/0 00000100:00100000:0.0:1788652093.853246:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 50 00000100:00100000:1.0:1788652093.862077:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652093.862201:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125579648 00000100:00100000:3.0:1788652093.862213:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125579648 00000100:00100000:3.0:1788652093.862292:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 51 00000100:00100000:3.0:1788652093.862303:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+34:15722:x1875537125579648:12345-192.168.204.45@tcp:36:bash.0 00010000:00010000:3.0:1788652093.862563:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.862582:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.862594:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788652093.862633:0:19982:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:3.0:1788652093.862655:0:19982:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004fad3e1b reply state 0000000054bce14d transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.862667:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.862674:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652093.862676:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788652093.862686:0:19982:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788652093.862776:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+37:15722:x1875537125579648:12345-192.168.204.45@tcp:36:bash.0 Request processed in 474us (709us total) trans 8589934618 rc 0/0 00000100:00100000:3.0:1788652093.862783:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 51 00000020:00080000:3.0:1788652093.862787:0:19982:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788652093.871973:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652093.872225:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125579776 00000100:00100000:0.0:1788652093.872236:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125579776 00000100:00100000:0.0:1788652093.872317:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 52 00000100:00100000:0.0:1788652093.872328:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+37:15722:x1875537125579776:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788652093.872352:0:19248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652093.872375:0:19248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c54f1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34174 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.872458:0:19248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c54f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34174 expref: 38 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.872474:0:19248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c54f1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34174 expref: 38 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.872491:0:19248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:0.0:1788652093.872495:0:19248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788652093.872499:0:19248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4a00, rc 0) 00000100:00100000:0.0:1788652093.872570:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+38:15722:x1875537125579776:12345-192.168.204.45@tcp:101:bash.0 Request processed in 243us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652093.872578:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 52 00000100:00100000:1.0:1788652093.883687:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652093.883831:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125579904 00000100:00100000:0.0:1788652093.883842:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125579904 00000100:00100000:0.0:1788652093.883940:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:0.0:1788652093.883952:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+38:15722:x1875537125579904:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:0.0:1788652093.883972:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652093.884001:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c54f8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3417b expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.884341:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c54ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.884357:0:17186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3416d expref: 39 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.884376:0:17186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c54ff lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.884412:0:17186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3416d expref: 39 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.884424:0:17186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3416d expref: 39 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652093.884438:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147680128:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788652093.886206:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d0e880c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652093.895288:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c348d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147680128:192.168.204.45@tcp:104: 00010000:00010000:0.0:1788652093.895321:0:17186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c54ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652093.897600:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652093.897694:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125580032 00000100:00100000:3.0:1788652093.897703:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125580032 00010000:00010000:3.0:1788652093.897745:0:18719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3416d expref: 40 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652093.897786:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:3.0:1788652093.897796:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+40:2389:x1875537125580032:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652093.897811:0:18719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652093.897819:0:18719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3416d expref: 40 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.897832:0:18719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3416d expref: 40 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.897853:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5400/0xcd2f56ea038c54dc lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3416d expref: 40 pid: 17186 timeout: 649 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.897870:0:18719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652093.897875:0:18719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c54ff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.897884:0:18719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c54ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.897953:0:18719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c54ff lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652093.897994:0:18719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652093.898054:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+39:2389:x1875537125580032:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 258us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652093.898062:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00010000:00010000:2.0:1788652093.898935:0:17186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c54ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.898946:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c54ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652093.899017:0:17186:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788652093.899022:0:17186:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788652093.899043:0:17186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c54ff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.899239:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4800/0xcd2f56ea038c54f8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3417b expref: 39 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.899258:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c54ff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3417b expref: 38 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.899266:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:2.0:1788652093.899279:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788652093.899282:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5e00, rc 0) 00000100:00100000:2.0:1788652093.899326:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+38:15722:x1875537125579904:12345-192.168.204.45@tcp:101:bash.0 Request processed in 15376us (15653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652093.899333:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 53 00000100:00100000:1.0:1788652093.902389:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652093.902462:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125580288 00000100:00100000:2.0:1788652093.902473:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125580288 00000100:00100000:2.0:1788652093.902543:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:2.0:1788652093.902554:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+38:15722:x1875537125580288:12345-192.168.204.45@tcp:103:bash.0 00010000:00010000:2.0:1788652093.902570:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788652093.902603:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c54f1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34174 expref: 38 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.902626:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5e00/0xcd2f56ea038c54ff lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3417b expref: 37 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.902656:0:17173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:2.0:1788652093.902662:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652093.902717:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+36:15722:x1875537125580288:12345-192.168.204.45@tcp:103:bash.0 Request processed in 165us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652093.902725:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 3 00000100:00100000:2.0:1788652093.916297:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652093.917693:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125580416 00000100:00100000:0.0:1788652093.917707:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125580416 00000100:00100000:0.0:1788652093.917775:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:0.0:1788652093.917784:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+36:15722:x1875537125580416:12345-192.168.204.45@tcp:58:bash.0 00010000:00010000:0.0:1788652093.917896:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.917949:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652093.917978:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652093.922108:0:17188:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788652093.922731:0:17188:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788652093.922864:0:17188:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788652093.923015:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+36:15722:x1875537125580416:12345-192.168.204.45@tcp:58:bash.0 Request processed in 5225us (6722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652093.923027:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 54 00000100:00100000:1.0:1788652093.925810:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652093.929621:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125580544 00000100:00100000:2.0:1788652093.929637:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125580544 00000100:00100000:2.0:1788652093.929720:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 55 00000100:00100000:2.0:1788652093.929731:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+36:15722:x1875537125580544:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:2.0:1788652093.929752:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652093.929773:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c550d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34182 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.929825:0:17187:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.929837:0:17187:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c550d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34182 expref: 37 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.929857:0:17187:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.929870:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c550d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34182 expref: 37 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.929884:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:2.0:1788652093.929902:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788652093.929962:0:17187:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c550d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34182 expref: 37 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652093.929972:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c7e00, rc 0) 00000100:00100000:2.0:1788652093.930040:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+37:15722:x1875537125580544:12345-192.168.204.45@tcp:101:bash.0 Request processed in 311us (4242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652093.930048:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 55 00010000:00010000:1.0:1788652093.984247:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652094.432573:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86ff49fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147680256:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788652094.432644:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652094.432848:0:18695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147680256 00000100:00100000:1.0:1788652094.432856:0:18695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147680256 00000100:00100000:1.0:1788652094.432927:0:18695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788652094.432987:0:18695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147680256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788652094.433010:0:18695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788652094.433077:0:18695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3635:x1875537147680256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652094.433153:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86ff49fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3635:1875537147680256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788652094.437766:0:18695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000040:00080000:2.0:1788652094.689649:0:17221:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788652094.689660:0:17221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788652094.689719:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788652094.689730:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788652094.689870:0:17221:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17221:1875537147680384:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788652094.690000:0:17221:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34dbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788652094.694838:0:17221:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17221:1875537147680384:192.168.204.45@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788652094.696416:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652094.696589:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125580672 00000100:00100000:2.0:1788652094.696598:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125580672 00000100:00100000:2.0:1788652094.696662:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:2.0:1788652094.696671:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+37:15723:x1875537125580672:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788652094.696705:0:17186:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788652094.696859:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+37:15723:x1875537125580672:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 188us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652094.696877:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 56 00000100:00100000:1.0:1788652094.702780:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652094.702888:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125580800 00000100:00100000:0.0:1788652094.702899:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125580800 00000100:00100000:0.0:1788652094.703039:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:0.0:1788652094.703050:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+37:15723:x1875537125580800:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788652094.703144:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5514 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703162:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5514 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703179:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5514 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703243:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c551b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703251:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c551b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703269:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c551b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703309:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5522 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703319:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5522 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703325:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5522 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652094.703378:0:17188:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788652094.703382:0:17188:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788652094.703402:0:17188:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5522 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703412:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5514 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703419:0:17188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5514 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703425:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5514 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703431:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652094.703435:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5514 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703443:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5514 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703454:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86ee978500) 00010000:00010000:0.0:1788652094.703462:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652094.703468:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5514 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703475:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c5514 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703489:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c551b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703495:0:17188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c551b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703500:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c551b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703505:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652094.703508:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c551b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703513:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c551b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703521:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8f86ee978800) 00010000:00010000:0.0:1788652094.703524:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652094.703527:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c551b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703533:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c551b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703545:0:17188:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5522 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703557:0:17188:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5522 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703563:0:17188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5522 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703567:0:17188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652094.703570:0:17188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5522 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703576:0:17188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5522 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703584:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:0.0:1788652094.703587:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652094.703589:0:17188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5522 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.703595:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c5522 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652094.703674:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+37:15723:x1875537125580800:12345-192.168.204.45@tcp:34:lhsmtool_posix.0 Request processed in 626us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652094.703682:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 57 00000100:00100000:1.0:1788652094.708360:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.708447:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125581056 00000100:00100000:3.0:1788652094.708456:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125581056 00000100:00100000:3.0:1788652094.708513:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:3.0:1788652094.708523:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+37:15723:x1875537125581056:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788652094.708545:0:19982:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652094.708568:0:19982:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5529 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34189 expref: -99 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.708677:0:19982:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5530 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.708694:0:19982:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5530 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.708706:0:19982:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5530 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788652094.708718:0:19982:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788652094.708791:0:19982:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5530 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.708799:0:19982:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5530 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.708820:0:19982:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5530 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.708826:0:19982:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788652094.708830:0:19982:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5530 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.708839:0:19982:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5530 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.708853:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652094.709053:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788652094.709060:0:19982:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5530 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.709068:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5530 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.709355:0:19982:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5529 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34189 expref: 39 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.709367:0:19982:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8f86ee978500) 00010000:00010000:3.0:1788652094.709370:0:19982:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788652094.709375:0:19982:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5529 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34189 expref: 39 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.709384:0:19982:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502a00, rc 0) 00000100:00100000:3.0:1788652094.709499:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+38:15723:x1875537125581056:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 977us (1149us total) trans 8589934619 rc 301/301 00000100:00100000:3.0:1788652094.709519:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 58 00000100:00100000:1.0:1788652094.715039:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652094.715094:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125581184 00000100:00100000:0.0:1788652094.715112:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125581184 00000100:00100000:0.0:1788652094.715168:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:0.0:1788652094.715178:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+38:15723:x1875537125581184:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788652094.715213:0:19248:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788652094.715354:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+38:15723:x1875537125581184:12345-192.168.204.45@tcp:53:lhsmtool_posix.0 Request processed in 176us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652094.715361:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 59 00000100:00100000:1.0:1788652094.721603:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652094.722406:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125581440 00000100:00100000:0.0:1788652094.722421:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125581440 00000100:00100000:0.0:1788652094.722511:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:0.0:1788652094.722522:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+38:15723:x1875537125581440:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652094.722543:0:17188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652094.722569:0:17188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c553e lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34190 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788652094.723383:0:17188:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x7:0x0], count =27 00000004:00080000:0.0:1788652094.723393:0:17188:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788652094.723414:0:17188:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x22:0x0], index 1: 0 00010000:00010000:0.0:1788652094.723586:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5545 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.723601:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5545 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.723613:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5545 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.723665:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c553e lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34190 expref: 41 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.723683:0:17188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5545 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34190 expref: 40 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.723710:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86ee978800) 00010000:00010000:0.0:1788652094.723712:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788652094.723716:0:17188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5c00, rc 0) 00000100:00100000:0.0:1788652094.723778:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+40:15723:x1875537125581440:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 1258us (2189us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788652094.723785:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 60 00000100:00100000:1.0:1788652094.731713:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.731816:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125581696 00000100:00100000:3.0:1788652094.731828:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125581696 00000100:00100000:3.0:1788652094.731896:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 61 00000100:00100000:3.0:1788652094.731925:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+40:15723:x1875537125581696:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788652094.732670:0:17186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652094.732704:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5545 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34190 expref: 40 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.732725:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86ee978800) 00010000:00010000:3.0:1788652094.732738:0:17186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652094.732763:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5553 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.732776:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5553 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.732787:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5553 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734463:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c555a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6e9cca1c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734481:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c555a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6e9cca1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734493:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c555a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6e9cca1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734571:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5553 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734579:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5553 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734585:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5553 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734591:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788652094.734597:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5553 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734604:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5553 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734618:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:3.0:1788652094.734621:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652094.734626:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5553 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734633:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5553 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734646:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c555a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6e9cca1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734652:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c555a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6e9cca1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734658:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c555a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6e9cca1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734669:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:3.0:1788652094.734673:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c555a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6e9cca1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734679:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c555a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6e9cca1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734687:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6e9cca1c (ffff8f85c3368400) 00010000:00010000:3.0:1788652094.734689:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788652094.734692:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c555a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6e9cca1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.734697:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c555a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6e9cca1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652094.734791:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+39:15723:x1875537125581696:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 2883us (3084us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788652094.734800:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 61 00000100:00100000:1.0:1788652094.739666:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652094.739754:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125581824 00000100:00100000:2.0:1788652094.739764:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125581824 00000100:00100000:2.0:1788652094.739821:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 62 00000100:00100000:2.0:1788652094.739832:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86ff49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+39:15723:x1875537125581824:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652094.739850:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652094.739885:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5561 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe34197 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.739968:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5568 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.739982:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5568 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.739993:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5568 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.740392:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6800/0xcd2f56ea038c5561 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34197 expref: 41 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.740413:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c6400/0xcd2f56ea038c5568 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34197 expref: 40 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.740421:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:2.0:1788652094.740424:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788652094.740427:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6400, rc 0) 00000100:00100000:2.0:1788652094.740487:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86ff49f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+40:15723:x1875537125581824:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 656us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652094.740500:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 62 00000100:00100000:1.0:1788652094.747994:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652094.748087:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125582080 00000100:00100000:0.0:1788652094.748099:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125582080 00000100:00100000:0.0:1788652094.748167:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 63 00000100:00100000:0.0:1788652094.748178:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+40:15723:x1875537125582080:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788652094.748346:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.748364:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.748379:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788652094.748765:0:17188:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1788652094.748776:0:17188:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 550683867532ns, next at 551683865117ns, rc = 0 00000004:00010000:0.0:1788652094.748831:0:17188:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba4fb42c reply state 0000000057d6842b transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.748846:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.748863:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:0.0:1788652094.748888:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788652094.748893:0:17188:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788652094.749048:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+42:15723:x1875537125582080:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 871us (1065us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788652094.749056:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 63 00000100:00100000:1.0:1788652094.754487:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.754875:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125582208 00000100:00100000:3.0:1788652094.754888:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125582208 00000100:00100000:3.0:1788652094.755088:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 64 00000100:00100000:3.0:1788652094.755100:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+42:15723:x1875537125582208:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788652094.755134:0:17186:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652094.755165:0:17186:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5576 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe3419e expref: -99 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.755237:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5576 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3419e expref: 43 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.755284:0:17186:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5576 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3419e expref: 43 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.755306:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:3.0:1788652094.755309:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788652094.755314:0:17186:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1503000, rc 0) 00000100:00100000:3.0:1788652094.755382:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+43:15723:x1875537125582208:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 286us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652094.755389:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 64 00000100:00100000:1.0:1788652094.773473:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652094.773782:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125582336 00000100:00100000:2.0:1788652094.773793:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125582336 00000100:00100000:2.0:1788652094.773871:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:2.0:1788652094.773885:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2389:x1875537125582336:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788652094.774415:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2389:x1875537125582336:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 533us (952us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788652094.774423:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00080000:1.0:1788652094.774496:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788652094.778864:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652094.779126:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125582592 00000100:00100000:0.0:1788652094.779137:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125582592 00000100:00100000:0.0:1788652094.779196:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:0.0:1788652094.779206:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+43:15723:x1875537125582592:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788652094.779482:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+44:15723:x1875537125582592:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 276us (627us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788652094.779489:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 11 00000100:00100000:0.0:1788652094.783529:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.784001:0:19982:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125582848 00000100:00100000:3.0:1788652094.784022:0:19982:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125582848 00000100:00100000:3.0:1788652094.784096:0:19982:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 65 00000100:00100000:3.0:1788652094.784107:0:19982:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+44:15723:x1875537125582848:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788652094.785499:0:19982:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:13cd7710-0d0a-4bf8-8621-85bf9f039118+44:15723:x1875537125582848:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 121us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652094.785512:0:19982:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 65 00000100:00100000:1.0:1788652094.791636:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652094.792131:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125582976 00000100:00100000:0.0:1788652094.792143:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125582976 00000100:00100000:0.0:1788652094.792222:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 66 00000100:00100000:0.0:1788652094.792243:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+44:15723:x1875537125582976:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652094.792278:0:17188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652094.792305:0:17188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c557d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe341a5 expref: -99 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.792398:0:17188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5584 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.792414:0:17188:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5584 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.792427:0:17188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5584 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788652094.792490:0:17188:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788652094.792508:0:17188:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5584 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.792534:0:17188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5a00/0xcd2f56ea038c557d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341a5 expref: 46 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.792551:0:17188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5584 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341a5 expref: 45 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.792560:0:17188:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:0.0:1788652094.792563:0:17188:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788652094.792579:0:17188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da5c00, rc 0) 00000100:00100000:0.0:1788652094.792646:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+45:15723:x1875537125582976:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 406us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652094.792654:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 66 00000100:00100000:1.0:1788652094.796318:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652094.797741:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125583104 00000100:00100000:0.0:1788652094.797760:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125583104 00000100:00100000:0.0:1788652094.797833:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:0.0:1788652094.797842:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86c376e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+6:2388:x1875537125583104:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788652094.797870:0:18694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788652094.797890:0:18694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b08f260/0xcd2f56ea038c558b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe341ac expref: -99 pid: 18694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788652094.797937:0:18694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9caa3e, blocks: 0x0 00010000:00010000:0.0:1788652094.797962:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=550s v=(0 0) 00010000:00010000:0.0:1788652094.797987:0:18694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788652094.797999:0:18694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b08f260/0xcd2f56ea038c558b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ac expref: 7 pid: 18694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.798020:0:18694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000b08f260/0xcd2f56ea038c558b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ac expref: 7 pid: 18694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.798035:0:18694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86e7da4200, rc 0) 00000100:00100000:0.0:1788652094.798366:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86c376e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:2388:x1875537125583104:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 524us (2057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652094.798375:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 24 00000100:00100000:1.0:1788652094.803742:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.809492:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125583360 00000100:00100000:3.0:1788652094.809508:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125583360 00000100:00100000:2.0:1788652094.816405:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00100000:2.0:1788652094.816427:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+45:15723:x1875537125583360:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788652094.816585:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+45:15723:x1875537125583360:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 167us (12853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652094.816593:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00100000:1.0:1788652094.828402:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652094.828516:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125583488 00000100:00100000:2.0:1788652094.828527:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125583488 00000100:00100000:2.0:1788652094.828784:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 68 00000100:00100000:2.0:1788652094.828796:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+45:15723:x1875537125583488:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788652094.834471:0:17167:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1788652094.834491:0:17167:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788652094.834584:0:17167:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788652094.834773:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+20:15723:x1875537125583488:12345-192.168.204.45@tcp:44:lhsmtool_posix.0 Request processed in 5971us (6376us total) trans 0 rc 0/0 00010000:00010000:0.0:1788652094.835129:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.835142:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652094.835148:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 68 00010000:00010000:0.0:1788652094.835155:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.835163:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652094.835168:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.835177:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.835195:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8f85c3373800) 00010000:00010000:0.0:1788652094.835198:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652094.835218:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652094.835477:0:3635:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788652094.835494:0:3635:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147680512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788652094.835556:0:3635:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652094.835600:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147680512 00000100:00100000:1.0:1788652094.835607:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147680512 00000100:00100000:1.0:1788652094.835647:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788652094.835657:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3635:x1875537147680512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788652094.835785:0:19081:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788652094.835788:0:19081:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788652094.835791:0:19081:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788652094.835794:0:19081:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788652094 -> 1788652094 00002000:00010000:1.0:1788652094.835796:0:19081:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1788652094.835833:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3635:x1875537147680512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 178us (277us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788652094.835840:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:1.0:1788652094.835883:0:3635:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8f85c3c89180/2, rc 0, transno 8589934596 00000100:00100000:1.0:1788652094.835889:0:3635:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3635:1875537147680512:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788652094.836156:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414c00/0xcd2f56ea038c534d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836188:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836196:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836203:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836209:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652094.836213:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836219:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.836366:0:3621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.836373:0:3621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.836379:0:3621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.836398:0:3621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:2.0:1788652094.836401:0:3621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.836408:0:3621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.836420:0:3621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:2.0:1788652094.836423:0:3621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788652094.836426:0:3621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.836432:0:3621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503a00/0xcd2f56ea038c53a1 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836483:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:0.0:1788652094.836486:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652094.836489:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836495:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414600/0xcd2f56ea038c5354 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836509:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836525:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836531:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836537:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652094.836540:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836547:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836556:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f86ee978c00) 00010000:00010000:0.0:1788652094.836558:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652094.836561:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836567:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4600/0xcd2f56ea038c53fc lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836583:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836589:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836595:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836599:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652094.836610:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836617:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836625:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:0.0:1788652094.836627:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652094.836630:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836636:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502000/0xcd2f56ea038c5481 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836649:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836655:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836661:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836666:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1503600 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652094.836669:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836675:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836682:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:0.0:1788652094.836684:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652094.836694:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836700:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503600/0xcd2f56ea038c54a4 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836712:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836718:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836723:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836728:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652094.836731:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836737:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836744:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:0.0:1788652094.836747:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788652094.836750:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836756:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c54ea lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19982 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836766:0:3622:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836772:0:3622:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836785:0:3622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836790:0:3622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4400 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:0.0:1788652094.836793:0:3622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836800:0:3622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836808:0:3622:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:0.0:1788652094.836810:0:3622:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788652094.836813:0:3622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.836819:0:3622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4400/0xcd2f56ea038c556f lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788652094.840559:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652094.840719:0:18694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125583616 00000100:00100000:2.0:1788652094.840731:0:18694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125583616 00000100:00100000:2.0:1788652094.840953:0:18694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:2.0:1788652094.840966:0:18694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:2390:x1875537125583616:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788652094.841077:0:18694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:2390:x1875537125583616:12345-192.168.204.45@tcp:16:lhsmtool_posix.0 Request processed in 113us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652094.841084:0:18694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 26 00000100:00100000:1.0:1788652094.847229:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.847368:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125583872 00000100:00100000:3.0:1788652094.847401:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125583872 00000100:00100000:3.0:1788652094.847486:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:3.0:1788652094.847497:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+14:15723:x1875537125583872:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788652094.847557:0:17187:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652094.847585:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5c00/0xcd2f56ea038c5584 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341a5 expref: 14 pid: 17188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.847605:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:3.0:1788652094.847610:0:17187:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788652094.847656:0:17187:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.847671:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.847682:0:17187:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788652094.847989:0:17187:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055db6019 reply state 00000000175d686e transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.848002:0:17187:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502a00/0xcd2f56ea038c5592 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17187 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.848009:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:3.0:1788652094.848012:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788652094.848014:0:17187:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788652094.848125:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+15:15723:x1875537125583872:12345-192.168.204.45@tcp:36:lhsmtool_posix.0 Request processed in 628us (913us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788652094.848133:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:1.0:1788652094.853984:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652094.854053:0:19081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125584000 00000100:00100000:2.0:1788652094.854064:0:19081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125584000 00000100:00100000:2.0:1788652094.854123:0:19081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 27 00000100:00100000:2.0:1788652094.854133:0:19081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:15723:x1875537125584000:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788652094.854151:0:19081:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652094.854182:0:19081:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe341b3 expref: -99 pid: 19081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.854218:0:19081:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000b08f260/0xcd2f56ea038c558b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ac expref: 8 pid: 18694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.854228:0:19081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652094.854233:0:19081:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652094.854239:0:19081:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 8 pid: 19081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.854286:0:19081:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000b08f260/0xcd2f56ea038c558b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ac expref: 8 pid: 18694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.854301:0:19081:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000b08f260/0xcd2f56ea038c558b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ac expref: 8 pid: 18694 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652094.854314:0:19081:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19081:1875537147680640:192.168.204.45@tcp:104: 00000100:00100000:2.0:1788652094.854392:0:19081:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db000 going to sleep for 11 seconds 00000100:00100000:2.0:1788652094.857992:0:19081:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f86f48d5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:19081:1875537147680640:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788652094.858033:0:19081:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 8 pid: 19081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.858066:0:19081:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f85c35c6800, rc 0) 00000100:00100000:2.0:1788652094.858137:0:19081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+8:15723:x1875537125584000:12345-192.168.204.45@tcp:101:lhsmtool_posix.0 Request processed in 4004us (4162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652094.858167:0:19081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 27 00000100:00100000:1.0:1788652094.861065:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.861276:0:18719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125584128 00000100:00100000:3.0:1788652094.861289:0:18719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125584128 00010000:00010000:3.0:1788652094.861340:0:18719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000b08f260/0xcd2f56ea038c558b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ac expref: 8 pid: 18694 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652094.861382:0:18719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:3.0:1788652094.861391:0:18719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+8:2388:x1875537125584128:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652094.861406:0:18719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652094.861429:0:18719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000b08f260/0xcd2f56ea038c558b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ac expref: 8 pid: 18694 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.861444:0:18719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000b08f260/0xcd2f56ea038c558b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ac expref: 8 pid: 18694 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.861468:0:18719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b08f260/0xcd2f56ea038c558b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ac expref: 8 pid: 18694 timeout: 650 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.861488:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652094.861492:0:18719:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652094.861498:0:18719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 7 pid: 19081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.861508:0:18719:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 7 pid: 19081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.861546:0:18719:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 7 pid: 19081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652094.861570:0:18719:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18719:1875537147680768:192.168.204.45@tcp:105: 00000100:00100000:3.0:1788652094.862070:0:18719:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d1349540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652094.871808:0:18719:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:18719:1875537147680768:192.168.204.45@tcp:105: 00010000:00010000:3.0:1788652094.871836:0:18719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652094.871889:0:18719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:2388:x1875537125584128:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 10498us (10839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652094.871899:0:18719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:0.0:1788652094.874619:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.874820:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125584256 00000100:00100000:3.0:1788652094.874833:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125584256 00000100:00100000:3.0:1788652094.874897:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:3.0:1788652094.874936:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:2389:x1875537125584256:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788652094.875133:0:18692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788652094.875137:0:18692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788652093 00002000:00010000:3.0:1788652094.875140:0:18692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788652091 00002000:00010000:3.0:1788652094.875143:0:18692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb ctime from disk: 1788652094 -> 1788652093 00002000:00010000:3.0:1788652094.875145:0:18692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788652094.875214:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+8:2389:x1875537125584256:12345-192.168.204.45@tcp:2:lhsmtool_posix.0 Request processed in 308us (607us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788652094.875221:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 28 00000100:00100000:1.0:1788652094.883303:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.883659:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125584384 00000100:00100000:3.0:1788652094.883672:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125584384 00000100:00100000:3.0:1788652094.883735:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:3.0:1788652094.883746:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+8:2389:x1875537125584384:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788652094.883817:0:18693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.883840:0:18693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 8 pid: 19081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.883849:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788652094.883853:0:18693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788652094.883858:0:18693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.883894:0:18693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 8 pid: 19081 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.883958:0:18693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 8 pid: 19081 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652094.883974:0:18693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18693:1875537147680896:192.168.204.45@tcp:104: 00000100:00100000:3.0:1788652094.884051:0:18693:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d1349540 going to sleep for 11 seconds 00000100:00100000:3.0:1788652094.887491:0:18693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:18693:1875537147680896:192.168.204.45@tcp:104: 00010000:00010000:3.0:1788652094.887527:0:18693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652094.890372:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652094.890709:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125584512 00000100:00100000:2.0:1788652094.890719:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125584512 00010000:00010000:2.0:1788652094.890767:0:17173:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 9 pid: 19081 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788652094.890812:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:2.0:1788652094.890823:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+9:2388:x1875537125584512:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788652094.890838:0:17173:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788652094.890861:0:17173:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 9 pid: 19081 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.890877:0:17173:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 9 pid: 19081 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.890901:0:17173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028366e39/0xcd2f56ea038c5599 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341b3 expref: 9 pid: 19081 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.890955:0:17173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788652094.890959:0:17173:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788652094.890966:0:17173:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.890977:0:17173:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.891032:0:17173:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652094.891105:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c89500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+8:2388:x1875537125584512:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 284us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652094.891113:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 21 00010000:00010000:3.0:1788652094.891434:0:18693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.891455:0:18693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.891477:0:18693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.891485:0:18693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.891492:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.891498:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c1502400 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:3.0:1788652094.891502:0:18693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.891510:0:18693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.891521:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.891529:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000610d8455/0xcd2f56ea038c55a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652094.891612:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:2389:x1875537125584384:12345-192.168.204.45@tcp:1:lhsmtool_posix.0 Request processed in 7868us (8323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652094.891621:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 29 00000100:00100000:1.0:1788652094.896375:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652094.896691:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125584768 00000100:00100000:2.0:1788652094.896703:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125584768 00000100:00100000:2.0:1788652094.896777:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 70 00000100:00100000:2.0:1788652094.896787:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+15:15723:x1875537125584768:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788652094.896882:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.896902:0:17186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c547a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34151 expref: 15 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.896957:0:17186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.897041:0:17186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c547a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34151 expref: 15 pid: 19982 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.897056:0:17186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c547a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34151 expref: 15 pid: 19982 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652094.897081:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c88380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147681024:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788652094.897167:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f85c34db000 going to sleep for 11 seconds 00000100:00100000:0.0:1788652094.904521:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652094.906504:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c88380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147681024:192.168.204.45@tcp:104: 00010000:00010000:2.0:1788652094.906536:0:17186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652094.906882:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125584896 00000100:00100000:3.0:1788652094.906892:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125584896 00010000:00010000:3.0:1788652094.906967:0:17172:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c547a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34151 expref: 16 pid: 19982 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652094.907020:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 22 00000100:00100000:3.0:1788652094.907030:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+16:2389:x1875537125584896:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652094.907046:0:17172:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652094.907054:0:17172:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c547a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34151 expref: 16 pid: 19982 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.907074:0:17172:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c547a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34151 expref: 16 pid: 19982 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.907098:0:17172:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c547a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34151 expref: 16 pid: 19982 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.907113:0:17172:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652094.907119:0:17172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c550d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34182 expref: 15 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.907130:0:17172:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.907153:0:17172:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.907160:0:17172:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.907271:0:17172:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788652094.907346:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+15:2389:x1875537125584896:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 316us (2836us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652094.907355:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 22 00010000:00010000:1.0:1788652094.907415:0:17186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.907424:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.907637:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.907651:0:17186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5576 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3419e expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.907659:0:17186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.907689:0:17186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5576 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3419e expref: 15 pid: 17186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.907700:0:17186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5576 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3419e expref: 15 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652094.907726:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147681152:192.168.204.45@tcp:104: 00000100:00100000:1.0:1788652094.907785:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86c2c2c600 going to sleep for 11 seconds 00000100:00100000:0.0:1788652094.919347:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.919580:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125585024 00000100:00100000:3.0:1788652094.919592:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125585024 00010000:00010000:3.0:1788652094.919640:0:17174:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5576 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3419e expref: 16 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652094.919683:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 23 00000100:00100000:3.0:1788652094.919692:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3386050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+16:2388:x1875537125585024:12345-192.168.204.45@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788652094.919707:0:17174:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788652094.919713:0:17174:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5576 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3419e expref: 16 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.919725:0:17174:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5576 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3419e expref: 16 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.919749:0:17174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:3.0:1788652094.919755:0:17174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.919765:0:17174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.919773:0:17174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.919824:0:17174:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788652094.919887:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3386050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+16:2388:x1875537125585024:12345-192.168.204.45@tcp:103:ldlm_bl.0 Request processed in 197us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652094.919894:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 23 00010000:00010000:1.0:1788652094.920175:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1503000/0xcd2f56ea038c5576 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe3419e expref: 15 pid: 17186 timeout: 650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652094.920195:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147681152:192.168.204.45@tcp:104: 00010000:00010000:1.0:1788652094.920219:0:17186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.920229:0:17186:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.920235:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788652094.920359:0:17186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1788652094.920486:0:17186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1788652094.920521:0:17186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1788652094.920620:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17186:1875537147681280:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788652094.920670:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652094.920703:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86ca848b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788652094.920741:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147681280 00000100:00100000:0.0:1788652094.920747:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147681280 00000100:00100000:0.0:1788652094.920797:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788652094.920806:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17186:x1875537147681280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788652094.920883:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17186:x1875537147681280:12345-0@lo:1000:mdt00_000.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788652094.920889:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788652094.921170:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17186:1875537147681280:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788652094.921319:0:17186:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:1.0:1788652094.921362:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17186:1875537147681408:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788652094.921391:0:17186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652094.921421:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2b676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652094.921456:0:18173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147681408 00000100:00100000:0.0:1788652094.921461:0:18173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147681408 00000100:00100000:0.0:1788652094.921494:0:18173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788652094.921501:0:18173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17186:x1875537147681408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788652094.921606:0:18173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17186:x1875537147681408:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (214us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788652094.921613:0:18173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788652094.922390:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c8a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:17186:1875537147681408:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788652094.922427:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922436:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922444:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922450:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652094.922455:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922463:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922480:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:1.0:1788652094.922484:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788652094.922489:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922495:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ae lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922531:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922538:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922543:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922562:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da5200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652094.922566:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922572:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922581:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:1.0:1788652094.922584:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788652094.922591:0:17186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c550d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34182 expref: 18 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922601:0:17186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c550d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34182 expref: 18 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922609:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c550d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34182 expref: 18 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.922665:0:17186:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8f85c35c7e00/0xcd2f56ea038c550d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe34182 expref: 18 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652094.922678:0:17186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147681536:192.168.204.45@tcp:105: 00000100:00100000:1.0:1788652094.922751:0:17186:0:(client.c:2716:ptlrpc_set_wait()) set ffff8f86d2b676c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788652094.925814:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.925892:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125585152 00000100:00100000:3.0:1788652094.925900:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125585152 00000100:00100000:1.0:1788652094.925943:0:17186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c89500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17186:1875537147681536:192.168.204.45@tcp:105: 00010000:00010000:1.0:1788652094.925975:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652094.925978:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 12 00000100:00100000:3.0:1788652094.925987:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+19:15722:x1875537125585152:12345-192.168.204.45@tcp:49:bash.0 00010000:00010000:1.0:1788652094.926002:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da5200/0xcd2f56ea038c5506 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 17188 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926121:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55b5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788652094.926127:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+19:15722:x1875537125585152:12345-192.168.204.45@tcp:49:bash.0 Request processed in 141us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652094.926133:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 12 00010000:00010000:1.0:1788652094.926134:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926145:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926155:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926162:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55b5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926168:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55b5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926174:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652094.926178:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55b5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926185:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55b5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926196:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:1.0:1788652094.926199:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652094.926203:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55b5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926215:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55b5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926225:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926231:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926236:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926240:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86c0031c00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652094.926243:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926258:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926268:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:1.0:1788652094.926271:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788652094.926273:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652094.926279:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031c00/0xcd2f56ea038c55a7 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652094.926408:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c3c8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+18:15723:x1875537125584768:12345-192.168.204.45@tcp:57:lhsmtool_posix.0 Request processed in 29622us (30043us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788652094.926416:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 70 00000020:00080000:1.0:1788652094.926425:0:17186:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788652094.926752:0:17221:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788652094.926757:0:17221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788652094.926790:0:17221:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788652094.926796:0:17221:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788652094.929217:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.929270:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652094.929333:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125585536 00000100:00100000:0.0:1788652094.929346:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125585536 00000100:00100000:2.0:1788652094.929356:0:18692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125585280 00000100:00100000:2.0:1788652094.929375:0:18692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125585280 00000100:00100000:2.0:1788652094.929413:0:18692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 30 00000100:00100000:0.0:1788652094.929413:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 13 00000100:00100000:2.0:1788652094.929423:0:18692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+7:15722:x1875537125585280:12345-192.168.204.45@tcp:101:bash.0 00000100:00100000:0.0:1788652094.929423:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+18:15723:x1875537125585536:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 00010000:00010000:2.0:1788652094.929443:0:18692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652094.929472:0:18692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ccbbabc/0xcd2f56ea038c55bc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe341ba expref: -99 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788652094.929500:0:18692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x6a9caa3d, atime: 0x6a9caa3b, ctime: 0x6a9caa3d, blocks: 0x0 00010000:00010000:2.0:1788652094.929520:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=550s v=(0 0) 00010000:00010000:2.0:1788652094.929526:0:18692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788652094.929535:0:18692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ccbbabc/0xcd2f56ea038c55bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ba expref: 8 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.929552:0:18692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005ccbbabc/0xcd2f56ea038c55bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341ba expref: 8 pid: 18692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.929564:0:18692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0031800, rc 0) 00000100:00100000:2.0:1788652094.929627:0:18692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+8:15722:x1875537125585280:12345-192.168.204.45@tcp:101:bash.0 Request processed in 206us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652094.929634:0:18692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 30 00000004:00080000:0.0:1788652094.929730:0:17189:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788652094.929763:0:17189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:0.0:1788652094.929945:0:17189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c55c3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.929960:0:17189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c55c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.929970:0:17189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c55c3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.929978:0:17189:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c55c3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.929985:0:17189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c55c3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.929992:0:17189:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c55c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788652094.930181:0:17189:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788652094.930238:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+20:15723:x1875537125585536:12345-192.168.204.45@tcp:35:lhsmtool_posix.0 Request processed in 816us (966us total) trans 8589934630 rc 0/0 00000100:00100000:0.0:1788652094.930247:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 13 00000020:00080000:0.0:1788652094.930263:0:17189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788652094.930714:0:17176:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788652094.930721:0:17176:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c55c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.930729:0:17176:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86e7da4a00 already unused, calling callback (ffffffffc0eb44f0) 00010000:00010000:2.0:1788652094.930733:0:17176:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c55c3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.930754:0:17176:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c55c3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.930769:0:17176:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8f86d455fa00) 00010000:00010000:2.0:1788652094.930772:0:17176:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788652094.930776:0:17176:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c55c3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.930782:0:17176:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86e7da4a00/0xcd2f56ea038c55c3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17189 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652094.930794:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652094.930796:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788652094.930798:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652094.936943:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.939404:0:19248:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125585664 00000100:00100000:3.0:1788652094.939421:0:19248:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125585664 00000100:00100000:3.0:1788652094.939498:0:19248:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 71 00000100:00100000:3.0:1788652094.939509:0:19248:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+20:15722:x1875537125585664:12345-192.168.204.45@tcp:101:bash.0 00010000:00010000:3.0:1788652094.939533:0:19248:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788652094.939558:0:19248:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c55ca lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe341c1 expref: -99 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.939600:0:19248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c55d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.939634:0:19248:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c55d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.939649:0:19248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c55d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19248 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.939762:0:19248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502400/0xcd2f56ea038c55ca lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341c1 expref: 22 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.939780:0:19248:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c1502200/0xcd2f56ea038c55d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341c1 expref: 21 pid: 19248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788652094.939789:0:19248:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:3.0:1788652094.939792:0:19248:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788652094.939796:0:19248:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c1502200, rc 0) 00000100:00100000:3.0:1788652094.939982:0:19248:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:13cd7710-0d0a-4bf8-8621-85bf9f039118+21:15722:x1875537125585664:12345-192.168.204.45@tcp:101:bash.0 Request processed in 475us (3076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652094.939990:0:19248:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 71 00000100:00100000:0.0:1788652094.943295:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652094.943441:0:17189:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125585920 00000100:00100000:3.0:1788652094.943452:0:17189:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125585920 00000100:00100000:3.0:1788652094.943510:0:17189:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 14 00000100:00100000:3.0:1788652094.943520:0:17189:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+21:15722:x1875537125585920:12345-192.168.204.45@tcp:35:bash.0 00000001:00080000:3.0:1788652094.943739:0:17189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1788652094.943968:0:17189:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:2.0:1788652094.944323:0:17189:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+24:15722:x1875537125585920:12345-192.168.204.45@tcp:35:bash.0 Request processed in 802us (1036us total) trans 8589934633 rc 0/0 00000100:00100000:2.0:1788652094.944338:0:17189:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 14 00000020:00080000:2.0:1788652094.944343:0:17189:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788652095.011146:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652095.039749:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:3.0:1788652095.040212:0:17187:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125586176 00000100:00100000:3.0:1788652095.040224:0:17187:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125586176 00000100:00100000:2.0:1788652095.040490:0:17187:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 72 00000100:00100000:2.0:1788652095.040503:0:17187:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+24:15733:x1875537125586176:12345-192.168.204.45@tcp:101:lfs.0 00010000:00010000:2.0:1788652095.040529:0:17187:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788652095.040551:0:17187:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031200/0xcd2f56ea038c55d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x46b75cdb9fe341c8 expref: -99 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788652095.040672:0:17187:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788652095.040777:0:17187:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031200/0xcd2f56ea038c55d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341c8 expref: 26 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652095.040820:0:17187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8f85c3368b00) 00010000:00010000:2.0:1788652095.040823:0:17187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788652095.040830:0:17187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86c0031200/0xcd2f56ea038c55d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.45@tcp remote: 0x46b75cdb9fe341c8 expref: 26 pid: 17187 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788652095.040847:0:17187:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8f86c0031200, rc 0) 00000100:00100000:2.0:1788652095.040950:0:17187:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+25:15733:x1875537125586176:12345-192.168.204.45@tcp:101:lfs.0 Request processed in 452us (1213us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788652095.040958:0:17187:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 72 00000100:00080000:1.0:1788652095.041005:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788652095.044080:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:1.0:1788652095.044178:0:17186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125586304 00000100:00100000:1.0:1788652095.044189:0:17186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125586304 00000100:00100000:1.0:1788652095.044262:0:17186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 73 00000100:00100000:1.0:1788652095.044273:0:17186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+25:15733:x1875537125586304:12345-192.168.204.45@tcp:34:lfs.0 00010000:00010000:1.0:1788652095.044368:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55e6 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044386:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55e6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044400:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55e6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044417:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ed lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044425:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044432:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044505:0:17186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414000/0xcd2f56ea038c55f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044514:0:17186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414000/0xcd2f56ea038c55f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044522:0:17186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414000/0xcd2f56ea038c55f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788652095.044757:0:17186:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414000/0xcd2f56ea038c55f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044772:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55e6 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044779:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55e6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044786:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55e6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044855:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff415200 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652095.044860:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55e6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044868:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55e6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044882:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8f85c3373100) 00010000:00010000:1.0:1788652095.044886:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652095.044891:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55e6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.044897:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff415200/0xcd2f56ea038c55e6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045731:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ed lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045742:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ed lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045761:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045765:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414a00 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652095.045769:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ed lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045776:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ed lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045787:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8f85c3373200) 00010000:00010000:1.0:1788652095.045854:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652095.045861:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ed lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045867:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414a00/0xcd2f56ea038c55ed lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045886:0:17186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414000/0xcd2f56ea038c55f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045892:0:17186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414000/0xcd2f56ea038c55f4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045897:0:17186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414000/0xcd2f56ea038c55f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045901:0:17186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8f86ff414000 already unused, calling callback (ffffffffc1aad4f0) 00010000:00010000:1.0:1788652095.045904:0:17186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414000/0xcd2f56ea038c55f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.045992:0:17186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414000/0xcd2f56ea038c55f4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.046001:0:17186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8f86ee978300) 00010000:00010000:1.0:1788652095.046003:0:17186:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788652095.046007:0:17186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414000/0xcd2f56ea038c55f4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788652095.046012:0:17186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8f86ff414000/0xcd2f56ea038c55f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17186 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788652095.046265:0:17186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c348c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+25:15733:x1875537125586304:12345-192.168.204.45@tcp:34:lfs.0 Request processed in 1991us (2191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652095.046275:0:17186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 73 00000100:00100000:3.0:1788652095.048967:0:3630:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652095.049386:0:17190:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125586560 00000100:00100000:0.0:1788652095.049398:0:17190:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125586560 00000100:00100000:0.0:1788652095.049550:0:17190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 15 00000100:00100000:0.0:1788652095.049562:0:17190:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+25:15733:x1875537125586560:12345-192.168.204.45@tcp:35:lfs.0 00000100:00100000:0.0:1788652095.050321:0:17190:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+26:15733:x1875537125586560:12345-192.168.204.45@tcp:35:lfs.0 Request processed in 755us (1529us total) trans 8589934635 rc 0/0 00000100:00100000:0.0:1788652095.050331:0:17190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 15 00000040:00080000:1.0:1788652095.328661:0:17941:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788652095.456590:0:3638:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788652095.456630:0:3638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c35c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147681664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788652095.456701:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788652095.456751:0:17191:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147681664 00000100:00100000:3.0:1788652095.456759:0:17191:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147681664 00000100:00100000:3.0:1788652095.456815:0:17191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788652095.456824:0:17191:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c35c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147681664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788652095.456857:0:17191:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788652095.456930:0:17191:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c35c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3638:x1875537147681664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652095.456937:0:17191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788652095.457043:0:3638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c35c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3638:1875537147681664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788652095.457147:0:3637:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788652095.457157:0:3637:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8f85c3c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147681792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788652095.457198:0:3637:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788652095.457340:0:17192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537147681792 00000100:00100000:1.0:1788652095.457345:0:17192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537147681792 00000100:00100000:1.0:1788652095.457378:0:17192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788652095.457385:0:17192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147681792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788652095.457405:0:17192:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788652095.457454:0:17192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3637:x1875537147681792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 69us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652095.457461:0:17192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788652095.458500:0:3637:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8f85c3c89500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3637:1875537147681792:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788652096.038776:0:19250:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652096.171633:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652096.171675:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652096.171705:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652096.171740:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652096.171763:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652096.171783:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652096.171806:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652096.171826:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652096.171851:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652096.171886:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125586944 00000100:00100000:2.0:1788652096.171898:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125586944 00000100:00100000:2.0:1788652096.171992:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125587456 00000100:00100000:2.0:1788652096.172010:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125587456 00000100:00100000:2.0:1788652096.172035:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125586816 00000100:00100000:2.0:1788652096.172037:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125586816 00000100:00100000:2.0:1788652096.172048:0:17188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125587328 00000100:00100000:2.0:1788652096.172050:0:17188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125587328 00000100:00100000:2.0:1788652096.172067:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00100000:2.0:1788652096.172077:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2388:x1875537125586944:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652096.172155:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2388:x1875537125586944:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 79us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652096.172162:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 67 00000100:00100000:2.0:1788652096.172179:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 68 00000100:00100000:2.0:1788652096.172186:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+5:2388:x1875537125587456:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652096.172210:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+5:2388:x1875537125587456:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 25us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652096.172216:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 68 00000100:00100000:2.0:1788652096.172238:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:2.0:1788652096.172245:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+26:2388:x1875537125586816:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652096.172272:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:13cd7710-0d0a-4bf8-8621-85bf9f039118+26:2388:x1875537125586816:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 28us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652096.172278:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 69 00000100:00100000:2.0:1788652096.172290:0:17188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 70 00000100:00100000:2.0:1788652096.172296:0:17188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+6:2388:x1875537125587328:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652096.172321:0:17188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f6da5325-c43d-45b2-9745-228d7048f21f+6:2388:x1875537125587328:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652096.172327:0:17188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 70 00000100:00100000:2.0:1788652096.172353:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125587200 00000100:00100000:2.0:1788652096.172356:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125587200 00000100:00100000:2.0:1788652096.172376:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125587712 00000100:00100000:2.0:1788652096.172378:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125587712 00000100:00100000:2.0:1788652096.172390:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125587072 00000100:00100000:2.0:1788652096.172392:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125587072 00000100:00100000:2.0:1788652096.172400:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125587584 00000100:00100000:2.0:1788652096.172403:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125587584 00000100:00100000:2.0:1788652096.172428:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:2.0:1788652096.172436:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+8:2388:x1875537125587200:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652096.172463:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+8:2388:x1875537125587200:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 29us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652096.172468:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 18 00000100:00100000:2.0:1788652096.172479:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:2.0:1788652096.172485:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+5:2388:x1875537125587712:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652096.172505:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+5:2388:x1875537125587712:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 21us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652096.172511:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 19 00000100:00100000:2.0:1788652096.172520:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:2.0:1788652096.172525:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f48d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2388:x1875537125587072:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652096.172544:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f48d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+5:2388:x1875537125587072:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 19us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652096.172550:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 20 00000100:00100000:2.0:1788652096.172560:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00100000:2.0:1788652096.172566:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+5:2388:x1875537125587584:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:2.0:1788652096.172584:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f6da5325-c43d-45b2-9745-228d7048f21f+5:2388:x1875537125587584:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 19us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788652096.172597:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 21 00000100:00080000:2.0:1788652096.172628:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788652096.172632:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788652096.172634:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788652096.172636:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788652096.173399:0:17182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125586688 00000100:00100000:1.0:1788652096.173406:0:17182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125586688 00000100:00100000:1.0:1788652096.173464:0:17182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 168 00000100:00100000:1.0:1788652096.173471:0:17182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f86f6691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2388:x1875537125586688:12345-192.168.204.45@tcp:400:kworker.0 00000100:00100000:1.0:1788652096.173535:0:17182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f86f6691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b8aeed4d-e02a-4884-ac38-7c6cb9ce8a0d+13:2388:x1875537125586688:12345-192.168.204.45@tcp:400:kworker.0 Request processed in 64us (1915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788652096.173552:0:17182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 168 00000001:02000400:1.0:1788652096.799664:0:20366:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:1.0:1788652097.057247:0:17176:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788652098.081748:0:17175:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788652098.213378:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:2.0:1788652098.213433:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.45@tcp (source: 12345-192.168.204.45@tcp) 00000100:00100000:0.0:1788652098.213603:0:18697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125587840 00000100:00100000:0.0:1788652098.213617:0:18697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125587840 00002000:00100000:0.0:1788652098.213693:0:18697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff8f85c368c700 x1875537125587840/t0(0) o4->13cd7710-0d0a-4bf8-8621-85bf9f039118@192.168.204.45@tcp:484/0 lens 504/0 e 0 to 0 dl 1788652109 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788652098.213704:0:18697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c368c700 with x1875537125587840 ext(0->8) 00002000:00010000:0.0:1788652098.213710:0:18697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f85c368c700 00000100:00100000:0.0:1788652098.213738:0:18697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 0 00000100:00100000:0.0:1788652098.213748:0:18697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+8:2388:x1875537125587840:12345-192.168.204.45@tcp:4:bash.0 00000100:00080000:2.0:1788652098.214413:0:17183:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788652098.214513:0:18693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875537125587968 00000100:00100000:3.0:1788652098.214522:0:18693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875537125587968 00000100:00100000:3.0:1788652098.214574:0:18693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:3.0:1788652098.214586:0:18693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8f85c368f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+9:2388:x1875537125587968:12345-192.168.204.45@tcp:16:kworker.0 00000100:00100000:3.0:1788652098.215049:0:18693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:13cd7710-0d0a-4bf8-8621-85bf9f039118+9:2388:x1875537125587968:12345-192.168.204.45@tcp:16:kworker.0 Request processed in 464us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788652098.215057:0:18693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 31 00000100:00100000:0.0:1788652098.221446:0:18697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8f85c368c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:13cd7710-0d0a-4bf8-8621-85bf9f039118+10:2388:x1875537125587840:12345-192.168.204.45@tcp:4:bash.0 Request processed in 7686us (7998us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788652098.221464:0:18697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.45@tcp, seq: 0 00002000:00100000:0.0:1788652098.221479:0:18697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x22:0x0] (0->8) req@ffff8f85c368c700 x1875537125587840/t8589934599(0) o4->13cd7710-0d0a-4bf8-8621-85bf9f039118@192.168.204.45@tcp:484/0 lens 504/448 e 0 to 0 dl 1788652109 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:0.0:1788652098.221490:0:18697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8f85c368c700 with x1875537125587840 ext(0->8) 00002000:00010000:0.0:1788652098.221497:0:18697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8f85c368c700 Debug log: 43278 lines, 43278 kept, 0 dropped, 0 bad.